2022-11-29T16:53:10.133 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-11-29T16:53:10.135 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} --name yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi/7096840 -- /home/teuthworker/archive/yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi/7096840/orig.config.yaml 2022-11-29T16:53:10.166 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-11-29T16:53:10.235 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi/7096840 branch: wip-yuri3-testing-2022-11-28-0750-pacific description: rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} email: ceph-qa@ceph.io first_in_suite: false job_id: '7096840' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri3-testing-2022-11-28-0750-pacific ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri3-testing-2022-11-28-0750-pacific sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 owner: scheduled_yuriw@teuthology priority: 61 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri3-testing-2022-11-28-0750-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8dc57b5624d909c1714a82ba84ff24e49431ea76/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 targets: smithi182.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDySGQiQQ9JsHqQM8Q52TvLLnevoONOGPGOccBpK4ERms3mAJVH8rLfi36nzbHX290jkMB/6hHvFaELw0IGj96HdOd1gxEKlsYW2JJ5ZA8U1d6IYJYr/MzCdn7WIwwmMOLxmARcz+58sbE5jMHj0nHtIfps0X9BebJF5v4b4W3IIxzcLsNLAMq8ItK2JjBADg9WJCL4dwU6jlg/PMMs43eqksw30nJQItKfHdyCKAZwT6754i26NVqr147hI9cojDEaMxyJ8Hy5j66hiBM7WQ8DxSkWUzABW+EGiqeJ3rCkicbAehGIQwOBGv5cWF5n/Ux4BgQvkgbU0XbovzBLeAP/Ld3INgbwMjsHQhUXLHhjq/r9yTyn+WPtHQr34GvKS21DeLyeG3X/hQen/e7IvimUoBQkMXcx89PcF6+1F8wKQXJoJYdIsBgqST738MoWiNAbhtY15f/YTLpIZ6DxZww78UKV3H87eeLXRB+x3/QyuSCXvyx52+yEVgPwWtyDIoE= smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCw31asIyFCjgH/airkhMqRGMkiFRkuNxaKxeV0goUpuDcGcE4NjJCWxDD0gkENoZb/n1nmCB7OK17Tlnq3Ob4XbHZOCnJzT2A8B6bomDLLTRmteJbsSlJwH4mTe4AwHzkYZiv9v2vCJuY+ga2Kv3afNP9elBklW/B02PCbRevPX/PwWtpmrRHzUO9pQ+StDgrFAiKY6Q+AJcCmqNmXXC7mnpfgaW6xTiqXFttciWWTxo7dtSH4NvQeLZmYPlVookw/jE4q7g0w41SZhegY9AwPsSLeyKpyH5oiQ9wm1R1w/nySZV2ghC2v3t2oDwEBh1xQLhOWV/Gf4aitNYqE4G0gJ0+EaDs50P+NyxsyeKeQ9yiWqCUCSOQso0QiZg5z49MgdbW+WFQnk0cZsAtWPBST7BxxZbgpj7I0mJudUCMywrTGbvJ/lqqz9yDffB+sNB/2UnEtedgUAmSja9ImdoFxIpIi9z52tmPm4nZYR3gyt1hskTIG6zpoFwgImJ1/f18= tasks: - nvme_loop: null - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - cephadm.shell: mon.a: - stat -c '%u %g' /var/log/ceph | grep '167 167' - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - ceph orch ls --format yaml - ceph orch ls | grep '^osd ' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 4da97cf64e542f347ec47b7bdbe5eca99759f9b7 timestamp: 2022-11-29_15:35:32 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20399 2022-11-29T16:53:10.236 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8dc57b5624d909c1714a82ba84ff24e49431ea76/qa; will attempt to use it 2022-11-29T16:53:10.237 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8dc57b5624d909c1714a82ba84ff24e49431ea76/qa/tasks 2022-11-29T16:53:10.237 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-11-29T16:53:10.244 INFO:teuthology.task.internal:Checking packages... 2022-11-29T16:53:10.275 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8dc57b5624d909c1714a82ba84ff24e49431ea76' 2022-11-29T16:53:10.275 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-11-29T16:53:10.276 INFO:teuthology.packaging:ref: None 2022-11-29T16:53:10.276 INFO:teuthology.packaging:tag: None 2022-11-29T16:53:10.276 INFO:teuthology.packaging:branch: wip-yuri3-testing-2022-11-28-0750-pacific 2022-11-29T16:53:10.277 INFO:teuthology.packaging:sha1: 8dc57b5624d909c1714a82ba84ff24e49431ea76 2022-11-29T16:53:10.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2022-11-28-0750-pacific 2022-11-29T16:53:10.443 INFO:teuthology.task.internal:Found packages for ceph version 16.2.10-1291.g8dc57b56 2022-11-29T16:53:10.444 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-11-29T16:53:10.450 INFO:teuthology.task.internal:no buildpackages task found 2022-11-29T16:53:10.451 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-11-29T16:53:10.487 INFO:teuthology.task.internal:Saving configuration 2022-11-29T16:53:10.501 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-11-29T16:53:10.507 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-29T16:53:10.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi182.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi/7096840', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-29 16:48:04.414693', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMDV8VUGfOydZctAzZBgPeBaI/nGwMIy0IsSKaP0IuqpLzQJT+m2Bxt58nPgoawsu5p1Zx22FMfVOa+MHdyfm4s='} 2022-11-29T16:53:10.557 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-29_15:35:32-rados-wip-yuri3-testing-2022-11-28-0750-pacific-distro-default-smithi/7096840', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-29 16:48:04.413190', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBMpMMox1oVdvTcS5fA34ZuJY1iGDegwCUWJ4s8KlyzeF/p0zezjSVHpgEVxZHnPg3eJ3kMb42gnA1H0i6cOeCc='} 2022-11-29T16:53:10.557 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-11-29T16:53:10.564 INFO:teuthology.task.internal:roles: ubuntu@smithi182.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-11-29T16:53:10.565 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-11-29T16:53:10.565 INFO:teuthology.run_tasks:Running task console_log... 2022-11-29T16:53:10.661 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e9e888f28>, signals=[15]) 2022-11-29T16:53:10.662 INFO:teuthology.run_tasks:Running task internal.connect... 2022-11-29T16:53:10.671 INFO:teuthology.task.internal:Opening connections... 2022-11-29T16:53:10.672 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi182.front.sepia.ceph.com 2022-11-29T16:53:10.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-29T16:53:10.772 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2022-11-29T16:53:10.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-29T16:53:10.849 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-11-29T16:53:10.855 DEBUG:teuthology.orchestra.run.smithi182:> uname -m 2022-11-29T16:53:10.876 INFO:teuthology.orchestra.run.smithi182.stdout:x86_64 2022-11-29T16:53:10.876 DEBUG:teuthology.orchestra.run.smithi182:> cat /etc/os-release 2022-11-29T16:53:10.934 INFO:teuthology.orchestra.run.smithi182.stdout:NAME="CentOS Stream" 2022-11-29T16:53:10.934 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION="8" 2022-11-29T16:53:10.934 INFO:teuthology.orchestra.run.smithi182.stdout:ID="centos" 2022-11-29T16:53:10.935 INFO:teuthology.orchestra.run.smithi182.stdout:ID_LIKE="rhel fedora" 2022-11-29T16:53:10.935 INFO:teuthology.orchestra.run.smithi182.stdout:VERSION_ID="8" 2022-11-29T16:53:10.935 INFO:teuthology.orchestra.run.smithi182.stdout:PLATFORM_ID="platform:el8" 2022-11-29T16:53:10.935 INFO:teuthology.orchestra.run.smithi182.stdout:PRETTY_NAME="CentOS Stream 8" 2022-11-29T16:53:10.936 INFO:teuthology.orchestra.run.smithi182.stdout:ANSI_COLOR="0;31" 2022-11-29T16:53:10.936 INFO:teuthology.orchestra.run.smithi182.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-11-29T16:53:10.936 INFO:teuthology.orchestra.run.smithi182.stdout:HOME_URL="https://centos.org/" 2022-11-29T16:53:10.936 INFO:teuthology.orchestra.run.smithi182.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-11-29T16:53:10.937 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-11-29T16:53:10.937 INFO:teuthology.orchestra.run.smithi182.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-11-29T16:53:10.938 INFO:teuthology.lock.ops:Updating smithi182.front.sepia.ceph.com on lock server 2022-11-29T16:53:10.960 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2022-11-29T16:53:10.982 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2022-11-29T16:53:10.983 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2022-11-29T16:53:11.042 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2022-11-29T16:53:11.042 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2022-11-29T16:53:11.043 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2022-11-29T16:53:11.043 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2022-11-29T16:53:11.043 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2022-11-29T16:53:11.043 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2022-11-29T16:53:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2022-11-29T16:53:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2022-11-29T16:53:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-11-29T16:53:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2022-11-29T16:53:11.044 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-11-29T16:53:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-11-29T16:53:11.045 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-11-29T16:53:11.045 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2022-11-29T16:53:11.065 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-11-29T16:53:11.078 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-11-29T16:53:11.096 INFO:teuthology.task.internal:Checking for old test directory... 2022-11-29T16:53:11.097 DEBUG:teuthology.orchestra.run.smithi182:> test '!' -e /home/ubuntu/cephtest 2022-11-29T16:53:11.102 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2022-11-29T16:53:11.121 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-11-29T16:53:11.128 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-11-29T16:53:11.128 DEBUG:teuthology.orchestra.run.smithi182:> test -z $(ls -A /var/lib/ceph) 2022-11-29T16:53:11.159 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2022-11-29T16:53:11.193 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-11-29T16:53:11.263 INFO:teuthology.run_tasks:Running task kernel... 2022-11-29T16:53:11.276 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-11-29T16:53:11.277 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-11-29T16:53:11.278 DEBUG:teuthology.orchestra.run.smithi182:> test -f /run/.containerenv -o -f /.dockerenv 2022-11-29T16:53:11.278 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2022-11-29T16:53:11.295 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-29T16:53:11.296 DEBUG:teuthology.orchestra.run.smithi182:> uname -r 2022-11-29T16:53:11.296 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-29T16:53:11.297 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2022-11-29T16:53:11.353 INFO:teuthology.orchestra.run.smithi182.stdout:4.18.0-408.el8.x86_64 2022-11-29T16:53:11.354 INFO:teuthology.task.kernel:Running kernel on smithi182: 4.18.0-408.el8.x86_64 2022-11-29T16:53:11.354 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum install -y kernel 2022-11-29T16:53:11.356 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-408.el8.x86_64 2022-11-29T16:53:11.356 INFO:teuthology.task.kernel:Running kernel on smithi191: 4.18.0-408.el8.x86_64 2022-11-29T16:53:11.357 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2022-11-29T16:53:14.734 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - AppStream 27 MB/s | 26 MB 00:00 2022-11-29T16:53:14.794 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - AppStream 26 MB/s | 26 MB 00:00 2022-11-29T16:53:20.091 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - BaseOS 36 MB/s | 26 MB 00:00 2022-11-29T16:53:20.164 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - BaseOS 35 MB/s | 26 MB 00:00 2022-11-29T16:53:24.090 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - Extras 133 kB/s | 18 kB 00:00 2022-11-29T16:53:24.101 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - Extras 176 kB/s | 18 kB 00:00 2022-11-29T16:53:24.492 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - PowerTools 20 MB/s | 5.3 MB 00:00 2022-11-29T16:53:24.509 INFO:teuthology.orchestra.run.smithi182.stdout:CentOS-8 - PowerTools 17 MB/s | 5.3 MB 00:00 2022-11-29T16:53:27.874 INFO:teuthology.orchestra.run.smithi182.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-11-29T16:53:28.211 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2022-11-29T16:53:29.117 INFO:teuthology.orchestra.run.smithi182.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2022-11-29T16:53:29.536 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2022-11-29T16:53:32.325 INFO:teuthology.orchestra.run.smithi182.stdout:lab-extras 604 kB/s | 24 kB 00:00 2022-11-29T16:53:32.719 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 656 kB/s | 24 kB 00:00 2022-11-29T16:53:35.281 INFO:teuthology.orchestra.run.smithi182.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-11-29T16:53:35.282 INFO:teuthology.orchestra.run.smithi182.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-11-29T16:53:35.430 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-11-29T16:53:35.431 INFO:teuthology.orchestra.run.smithi182.stdout:Nothing to do. 2022-11-29T16:53:35.431 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-11-29T16:53:35.531 DEBUG:teuthology.orchestra.run.smithi182:> echo no | sudo yum reinstall kernel || true 2022-11-29T16:53:35.749 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-11-29T16:53:35.749 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-11-29T16:53:35.886 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-11-29T16:53:35.887 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-11-29T16:53:35.888 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-11-29T16:53:35.998 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2022-11-29T16:53:36.114 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:00:04 ago on Tue 29 Nov 2022 04:53:32 PM UTC. 2022-11-29T16:53:36.621 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:04 ago on Tue 29 Nov 2022 04:53:32 PM UTC. 2022-11-29T16:53:37.199 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-11-29T16:53:37.201 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:37.201 INFO:teuthology.orchestra.run.smithi182.stdout: Package Architecture Version Repository Size 2022-11-29T16:53:37.201 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:37.201 INFO:teuthology.orchestra.run.smithi182.stdout:Reinstalling: 2022-11-29T16:53:37.202 INFO:teuthology.orchestra.run.smithi182.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-11-29T16:53:37.202 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:37.202 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2022-11-29T16:53:37.202 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:37.202 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:37.203 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 8.5 M 2022-11-29T16:53:37.203 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 0 2022-11-29T16:53:37.203 INFO:teuthology.orchestra.run.smithi182.stderr:Operation aborted. 2022-11-29T16:53:37.257 INFO:teuthology.orchestra.run.smithi182.stdout:Is this ok [y/N]: 2022-11-29T16:53:37.258 DEBUG:teuthology.orchestra.run.smithi182:> sudo yum reinstall -y kernel || true 2022-11-29T16:53:37.736 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-11-29T16:53:37.737 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:37.737 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-11-29T16:53:37.738 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:37.738 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2022-11-29T16:53:37.738 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-11-29T16:53:37.738 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:37.738 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-11-29T16:53:37.739 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:37.739 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:37.739 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 8.5 M 2022-11-29T16:53:37.739 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2022-11-29T16:53:37.740 INFO:teuthology.orchestra.run.smithi191.stderr:Operation aborted. 2022-11-29T16:53:37.802 INFO:teuthology.orchestra.run.smithi191.stdout:Is this ok [y/N]: 2022-11-29T16:53:37.803 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2022-11-29T16:53:37.834 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:00:05 ago on Tue 29 Nov 2022 04:53:32 PM UTC. 2022-11-29T16:53:38.382 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:06 ago on Tue 29 Nov 2022 04:53:32 PM UTC. 2022-11-29T16:53:38.891 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-11-29T16:53:38.892 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:38.892 INFO:teuthology.orchestra.run.smithi182.stdout: Package Architecture Version Repository Size 2022-11-29T16:53:38.892 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:38.893 INFO:teuthology.orchestra.run.smithi182.stdout:Reinstalling: 2022-11-29T16:53:38.893 INFO:teuthology.orchestra.run.smithi182.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-11-29T16:53:38.893 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:38.893 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2022-11-29T16:53:38.894 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T16:53:38.894 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:38.894 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 8.5 M 2022-11-29T16:53:38.894 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 0 2022-11-29T16:53:38.895 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2022-11-29T16:53:39.101 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-4.18.0-408.el8.x86_64.rpm 41 MB/s | 8.5 MB 00:00 2022-11-29T16:53:39.102 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2022-11-29T16:53:39.103 INFO:teuthology.orchestra.run.smithi182.stdout:Total 41 MB/s | 8.5 MB 00:00 2022-11-29T16:53:39.197 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2022-11-29T16:53:39.457 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-11-29T16:53:39.458 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:39.458 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-11-29T16:53:39.458 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:39.459 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2022-11-29T16:53:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-11-29T16:53:39.459 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:39.459 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-11-29T16:53:39.460 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T16:53:39.460 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:39.460 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 8.5 M 2022-11-29T16:53:39.460 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2022-11-29T16:53:39.461 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-11-29T16:53:39.599 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2022-11-29T16:53:39.600 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2022-11-29T16:53:39.687 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-408.el8.x86_64.rpm 37 MB/s | 8.5 MB 00:00 2022-11-29T16:53:39.688 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-11-29T16:53:39.688 INFO:teuthology.orchestra.run.smithi191.stdout:Total 37 MB/s | 8.5 MB 00:00 2022-11-29T16:53:39.767 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2022-11-29T16:53:39.777 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2022-11-29T16:53:39.785 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-11-29T16:53:40.047 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2022-11-29T16:53:40.207 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-11-29T16:53:40.208 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-11-29T16:53:40.259 INFO:teuthology.orchestra.run.smithi182.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-11-29T16:53:40.259 INFO:teuthology.orchestra.run.smithi182.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:40.370 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-11-29T16:53:40.385 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-11-29T16:53:40.670 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:40.670 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-11-29T16:53:40.682 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-11-29T16:53:40.896 INFO:teuthology.orchestra.run.smithi191.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-11-29T16:53:40.897 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:41.185 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:41.185 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:41.185 INFO:teuthology.orchestra.run.smithi182.stdout:Reinstalled: 2022-11-29T16:53:41.186 INFO:teuthology.orchestra.run.smithi182.stdout: kernel-4.18.0-408.el8.x86_64 2022-11-29T16:53:41.186 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T16:53:41.186 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-11-29T16:53:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:41.318 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-11-29T16:53:41.327 DEBUG:teuthology.orchestra.run.smithi182:> rpm -q kernel --last | head -n 1 2022-11-29T16:53:41.461 INFO:teuthology.orchestra.run.smithi182.stdout:kernel-4.18.0-408.el8.x86_64 Tue 29 Nov 2022 04:53:40 PM UTC 2022-11-29T16:53:41.462 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-11-29T16:53:41.463 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-11-29T16:53:41.463 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-11-29T16:53:41.463 DEBUG:teuthology.orchestra.run.smithi182:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-11-29T16:53:41.504 INFO:teuthology.orchestra.run.smithi182.stdout:ttyS1 2022-11-29T16:53:41.517 DEBUG:teuthology.parallel:result is None 2022-11-29T16:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-11-29T16:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalled: 2022-11-29T16:53:41.786 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-4.18.0-408.el8.x86_64 2022-11-29T16:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T16:53:41.787 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-11-29T16:53:41.892 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel --last | head -n 1 2022-11-29T16:53:42.035 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-408.el8.x86_64 Tue 29 Nov 2022 04:53:40 PM UTC 2022-11-29T16:53:42.037 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-11-29T16:53:42.037 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-11-29T16:53:42.038 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-11-29T16:53:42.038 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-11-29T16:53:42.069 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2022-11-29T16:53:42.080 DEBUG:teuthology.parallel:result is None 2022-11-29T16:53:42.080 INFO:teuthology.run_tasks:Running task internal.base... 2022-11-29T16:53:42.088 INFO:teuthology.task.internal:Creating test directory... 2022-11-29T16:53:42.089 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-11-29T16:53:42.091 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-11-29T16:53:42.138 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-11-29T16:53:42.146 INFO:teuthology.run_tasks:Running task internal.archive... 2022-11-29T16:53:42.170 INFO:teuthology.task.internal:Creating archive directory... 2022-11-29T16:53:42.171 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-11-29T16:53:42.174 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-11-29T16:53:42.208 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-11-29T16:53:42.218 INFO:teuthology.task.internal:Enabling coredump saving... 2022-11-29T16:53:42.219 DEBUG:teuthology.orchestra.run.smithi182:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-11-29T16:53:42.238 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-11-29T16:53:42.274 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-29T16:53:42.275 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-29T16:53:42.284 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-29T16:53:42.285 INFO:teuthology.orchestra.run.smithi182.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-29T16:53:42.287 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-11-29T16:53:42.295 INFO:teuthology.task.internal:Configuring sudo... 2022-11-29T16:53:42.295 DEBUG:teuthology.orchestra.run.smithi182:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-11-29T16:53:42.329 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-11-29T16:53:42.357 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-11-29T16:53:42.367 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-11-29T16:53:42.367 DEBUG:teuthology.orchestra.run.smithi182:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-11-29T16:53:42.397 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-11-29T16:53:42.415 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-29T16:53:42.500 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-29T16:53:42.546 DEBUG:teuthology.orchestra.run.smithi182:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-29T16:53:42.631 DEBUG:teuthology.orchestra.run.smithi182:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-29T16:53:42.672 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T16:53:42.672 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-11-29T16:53:42.739 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-29T16:53:42.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-29T16:53:42.835 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-29T16:53:42.920 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-29T16:53:42.961 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T16:53:42.961 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-11-29T16:53:43.029 DEBUG:teuthology.orchestra.run.smithi182:> sudo service rsyslog restart 2022-11-29T16:53:43.031 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2022-11-29T16:53:43.084 INFO:teuthology.orchestra.run.smithi182.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-11-29T16:53:43.131 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-11-29T16:53:43.591 INFO:teuthology.run_tasks:Running task internal.timer... 2022-11-29T16:53:43.600 INFO:teuthology.task.internal:Starting timer... 2022-11-29T16:53:43.600 INFO:teuthology.run_tasks:Running task pcp... 2022-11-29T16:53:43.632 INFO:teuthology.run_tasks:Running task selinux... 2022-11-29T16:53:43.664 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-11-29T16:53:43.665 DEBUG:teuthology.orchestra.run.smithi182:> sudo service auditd rotate 2022-11-29T16:53:43.739 INFO:teuthology.orchestra.run.smithi182.stdout:Rotating logs: 2022-11-29T16:53:43.741 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2022-11-29T16:53:43.812 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2022-11-29T16:53:43.815 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-11-29T16:53:43.816 DEBUG:teuthology.orchestra.run.smithi182:> /usr/sbin/getenforce 2022-11-29T16:53:43.839 INFO:teuthology.orchestra.run.smithi182.stdout:Permissive 2022-11-29T16:53:43.840 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2022-11-29T16:53:43.868 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2022-11-29T16:53:43.869 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi182.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2022-11-29T16:53:43.869 DEBUG:teuthology.orchestra.run.smithi182:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-11-29T16:53:43.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-29T16:53:43.909 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-11-29T16:53:43.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-29T16:53:43.938 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-11-29T16:53:43.938 DEBUG:teuthology.orchestra.run.smithi182:> sudo /usr/sbin/setenforce permissive 2022-11-29T16:53:43.984 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2022-11-29T16:53:44.020 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-11-29T16:53:44.037 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2022-11-29T16:53:44.044 INFO:teuthology.repo_utils:Fetching main from origin 2022-11-29T16:53:44.172 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2022-11-29T16:53:44.192 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-11-29T16:53:44.194 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi182.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2022-11-29T17:00:41.124 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi182.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2022-11-29T17:00:41.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi182.front.sepia.ceph.com' 2022-11-29T17:00:41.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi182.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-29T17:00:41.221 DEBUG:teuthology.orchestra.run.smithi182:> true 2022-11-29T17:00:41.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2022-11-29T17:00:41.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-29T17:00:41.366 DEBUG:teuthology.orchestra.run.smithi191:> true 2022-11-29T17:00:41.433 INFO:teuthology.run_tasks:Running task clock... 2022-11-29T17:00:41.448 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-11-29T17:00:41.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-11-29T17:00:41.451 DEBUG:teuthology.orchestra.run.smithi182:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-11-29T17:00:41.454 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-11-29T17:00:41.454 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-11-29T17:00:41.482 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-11-29T17:00:41.496 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-11-29T17:00:41.505 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-11-29T17:00:41.518 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-11-29T17:00:41.565 INFO:teuthology.orchestra.run.smithi182.stderr:sudo: ntpd: command not found 2022-11-29T17:00:41.576 INFO:teuthology.orchestra.run.smithi182.stdout:506 Cannot talk to daemon 2022-11-29T17:00:41.590 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-11-29T17:00:41.591 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2022-11-29T17:00:41.603 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2022-11-29T17:00:41.603 INFO:teuthology.orchestra.run.smithi182.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-11-29T17:00:41.617 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-11-29T17:00:41.630 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-11-29T17:00:41.669 INFO:teuthology.orchestra.run.smithi182.stderr:bash: ntpq: command not found 2022-11-29T17:00:41.672 INFO:teuthology.orchestra.run.smithi182.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-11-29T17:00:41.673 INFO:teuthology.orchestra.run.smithi182.stdout:=============================================================================== 2022-11-29T17:00:41.673 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.673 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.673 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.673 INFO:teuthology.orchestra.run.smithi182.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.703 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2022-11-29T17:00:41.708 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-11-29T17:00:41.708 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2022-11-29T17:00:41.709 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.709 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.710 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.710 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-29T17:00:41.711 INFO:teuthology.run_tasks:Running task nvme_loop... 2022-11-29T17:00:41.725 INFO:tasks.nvme_loop:Setting up nvme_loop on scratch devices... 2022-11-29T17:00:41.726 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:00:41.726 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:00:41.745 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-11-29T17:00:41.745 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_1 2022-11-29T17:00:41.802 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-11-29T17:00:41.803 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:41.803 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 382181 Links: 1 2022-11-29T17:00:41.804 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:41.804 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:41.804 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:00:39.814023609 +0000 2022-11-29T17:00:41.805 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:00:11.042717044 +0000 2022-11-29T17:00:41.805 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:00:11.042717044 +0000 2022-11-29T17:00:41.806 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:00:41.806 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-11-29T17:00:41.869 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:00:41.869 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:00:41.870 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000263751 s, 1.9 MB/s 2022-11-29T17:00:41.872 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-11-29T17:00:41.930 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_2 2022-11-29T17:00:41.988 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-11-29T17:00:41.988 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:41.989 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 380255 Links: 1 2022-11-29T17:00:41.989 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:41.989 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:41.989 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:00:39.814023609 +0000 2022-11-29T17:00:41.990 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:00:11.605704443 +0000 2022-11-29T17:00:41.990 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:00:11.605704443 +0000 2022-11-29T17:00:41.990 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:00:41.990 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-11-29T17:00:42.061 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:00:42.061 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:00:42.061 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000200395 s, 2.6 MB/s 2022-11-29T17:00:42.062 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-11-29T17:00:42.119 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_3 2022-11-29T17:00:42.177 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-11-29T17:00:42.178 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:42.178 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 379357 Links: 1 2022-11-29T17:00:42.178 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:42.178 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:42.179 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:00:39.814023609 +0000 2022-11-29T17:00:42.179 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:00:12.169691820 +0000 2022-11-29T17:00:42.179 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:00:12.169691820 +0000 2022-11-29T17:00:42.179 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:00:42.180 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-11-29T17:00:42.243 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:00:42.244 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:00:42.244 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000202556 s, 2.5 MB/s 2022-11-29T17:00:42.245 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-11-29T17:00:42.304 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/vg_nvme/lv_4 2022-11-29T17:00:42.362 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-11-29T17:00:42.363 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:42.363 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 378396 Links: 1 2022-11-29T17:00:42.363 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:42.364 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:42.364 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:00:39.814023609 +0000 2022-11-29T17:00:42.365 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:00:12.742678995 +0000 2022-11-29T17:00:42.365 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:00:12.742678995 +0000 2022-11-29T17:00:42.365 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:00:42.366 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-11-29T17:00:42.428 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:00:42.428 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:00:42.428 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000226755 s, 2.3 MB/s 2022-11-29T17:00:42.429 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-11-29T17:00:42.490 DEBUG:teuthology.orchestra.run.smithi182:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2022-11-29T17:00:42.606 INFO:teuthology.orchestra.run.smithi182.stdout:loop 2022-11-29T17:00:42.607 INFO:tasks.nvme_loop:Connecting nvme_loop smithi182:/dev/vg_nvme/lv_1... 2022-11-29T17:00:42.608 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2022-11-29T17:00:42.642 INFO:teuthology.orchestra.run.smithi182.stdout:1 2022-11-29T17:00:42.676 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/vg_nvme/lv_11 2022-11-29T17:00:42.716 INFO:tasks.nvme_loop:Connecting nvme_loop smithi182:/dev/vg_nvme/lv_2... 2022-11-29T17:00:42.717 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2022-11-29T17:00:42.792 INFO:teuthology.orchestra.run.smithi182.stdout:1 2022-11-29T17:00:42.826 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/vg_nvme/lv_21 2022-11-29T17:00:42.864 INFO:tasks.nvme_loop:Connecting nvme_loop smithi182:/dev/vg_nvme/lv_3... 2022-11-29T17:00:42.865 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2022-11-29T17:00:42.939 INFO:teuthology.orchestra.run.smithi182.stdout:1 2022-11-29T17:00:42.974 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/vg_nvme/lv_31 2022-11-29T17:00:43.063 INFO:tasks.nvme_loop:Connecting nvme_loop smithi182:/dev/vg_nvme/lv_4... 2022-11-29T17:00:43.064 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2022-11-29T17:00:43.143 INFO:teuthology.orchestra.run.smithi182.stdout:1 2022-11-29T17:00:43.183 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/vg_nvme/lv_41 2022-11-29T17:00:43.273 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:00:43.273 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:00:43.331 DEBUG:teuthology.orchestra.run.smithi182:> sudo nvme list 2022-11-29T17:00:43.397 INFO:teuthology.orchestra.run.smithi182.stdout:Node SN Model Namespace Usage Format FW Rev 2022-11-29T17:00:43.397 INFO:teuthology.orchestra.run.smithi182.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2022-11-29T17:00:43.397 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/nvme0n1 CVFT6161005T400BGN INTEL SSDPEDMD400G4 1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2022-11-29T17:00:43.398 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/nvme1n1 e7214870938ef0074895 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:43.398 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/nvme2n1 90ccab7876ddee9d3b3f Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:43.398 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/nvme3n1 7e64b977a0c886141fb4 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:43.398 INFO:teuthology.orchestra.run.smithi182.stdout:/dev/nvme4n1 a0a69c22c20558e4584c Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:43.399 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2022-11-29T17:00:43.400 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:00:43.400 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/scratch_devs 2022-11-29T17:00:43.466 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:00:43.467 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:00:43.486 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-11-29T17:00:43.487 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 2022-11-29T17:00:43.545 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-11-29T17:00:43.546 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:43.546 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 381981 Links: 1 2022-11-29T17:00:43.547 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:43.547 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:43.548 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:00:39.846122108 +0000 2022-11-29T17:00:43.548 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:00:11.039642438 +0000 2022-11-29T17:00:43.549 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:00:11.039642438 +0000 2022-11-29T17:00:43.549 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:00:43.550 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-11-29T17:00:43.612 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:00:43.613 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:00:43.613 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000256227 s, 2.0 MB/s 2022-11-29T17:00:43.615 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-11-29T17:00:43.684 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 2022-11-29T17:00:43.743 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-11-29T17:00:43.743 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:43.743 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 372315 Links: 1 2022-11-29T17:00:43.744 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:43.744 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:43.744 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:00:39.846122108 +0000 2022-11-29T17:00:43.745 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:00:11.618631981 +0000 2022-11-29T17:00:43.745 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:00:11.618631981 +0000 2022-11-29T17:00:43.745 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:00:43.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-11-29T17:00:43.812 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:00:43.812 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:00:43.812 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000291892 s, 1.8 MB/s 2022-11-29T17:00:43.813 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-11-29T17:00:43.871 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 2022-11-29T17:00:43.928 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-11-29T17:00:43.929 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:43.929 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 380383 Links: 1 2022-11-29T17:00:43.930 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:43.930 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:43.930 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:00:39.846122108 +0000 2022-11-29T17:00:43.930 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:00:12.191621630 +0000 2022-11-29T17:00:43.931 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:00:12.191621630 +0000 2022-11-29T17:00:43.931 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:00:43.931 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-11-29T17:00:43.994 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:00:43.995 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:00:43.995 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000218182 s, 2.3 MB/s 2022-11-29T17:00:43.996 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-11-29T17:00:44.055 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 2022-11-29T17:00:44.114 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-11-29T17:00:44.115 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-29T17:00:44.115 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 383145 Links: 1 2022-11-29T17:00:44.116 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-29T17:00:44.116 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-11-29T17:00:44.116 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:00:39.846122108 +0000 2022-11-29T17:00:44.117 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:00:12.751611515 +0000 2022-11-29T17:00:44.117 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:00:12.751611515 +0000 2022-11-29T17:00:44.117 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:00:44.117 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-11-29T17:00:44.182 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:00:44.183 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:00:44.183 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000222424 s, 2.3 MB/s 2022-11-29T17:00:44.184 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-11-29T17:00:44.242 DEBUG:teuthology.orchestra.run.smithi191:> sudo modprobe nvme_loop && sudo mkdir -p /sys/kernel/config/nvmet/hosts/hostnqn && sudo mkdir -p /sys/kernel/config/nvmet/ports/1 && echo loop | sudo tee /sys/kernel/config/nvmet/ports/1/addr_trtype 2022-11-29T17:00:44.378 INFO:teuthology.orchestra.run.smithi191.stdout:loop 2022-11-29T17:00:44.379 INFO:tasks.nvme_loop:Connecting nvme_loop smithi191:/dev/vg_nvme/lv_1... 2022-11-29T17:00:44.380 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo -n /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn 2022-11-29T17:00:44.415 INFO:teuthology.orchestra.run.smithi191.stdout:1 2022-11-29T17:00:44.448 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/vg_nvme/lv_11 2022-11-29T17:00:44.488 INFO:tasks.nvme_loop:Connecting nvme_loop smithi191:/dev/vg_nvme/lv_2... 2022-11-29T17:00:44.489 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1 && echo -n /dev/vg_nvme/lv_2 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_2/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_2 /sys/kernel/config/nvmet/ports/1/subsystems/lv_2 && sudo nvme connect -t loop -n lv_2 -q hostnqn 2022-11-29T17:00:44.566 INFO:teuthology.orchestra.run.smithi191.stdout:1 2022-11-29T17:00:44.600 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/vg_nvme/lv_21 2022-11-29T17:00:44.639 INFO:tasks.nvme_loop:Connecting nvme_loop smithi191:/dev/vg_nvme/lv_3... 2022-11-29T17:00:44.640 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1 && echo -n /dev/vg_nvme/lv_3 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_3/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_3 /sys/kernel/config/nvmet/ports/1/subsystems/lv_3 && sudo nvme connect -t loop -n lv_3 -q hostnqn 2022-11-29T17:00:44.715 INFO:teuthology.orchestra.run.smithi191.stdout:1 2022-11-29T17:00:44.749 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/vg_nvme/lv_31 2022-11-29T17:00:44.839 INFO:tasks.nvme_loop:Connecting nvme_loop smithi191:/dev/vg_nvme/lv_4... 2022-11-29T17:00:44.840 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1 && echo -n /dev/vg_nvme/lv_4 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_4/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_4 /sys/kernel/config/nvmet/ports/1/subsystems/lv_4 && sudo nvme connect -t loop -n lv_4 -q hostnqn 2022-11-29T17:00:44.915 INFO:teuthology.orchestra.run.smithi191.stdout:1 2022-11-29T17:00:44.955 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/vg_nvme/lv_41 2022-11-29T17:00:45.045 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:00:45.045 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:00:45.103 DEBUG:teuthology.orchestra.run.smithi191:> sudo nvme list 2022-11-29T17:00:45.169 INFO:teuthology.orchestra.run.smithi191.stdout:Node SN Model Namespace Usage Format FW Rev 2022-11-29T17:00:45.170 INFO:teuthology.orchestra.run.smithi191.stdout:---------------- -------------------- ---------------------------------------- --------- -------------------------- ---------------- -------- 2022-11-29T17:00:45.170 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/nvme0n1 CVFT6303008M400BGN INTEL SSDPEDMD400G4 1 400.09 GB / 400.09 GB 512 B + 0 B 8DV101H0 2022-11-29T17:00:45.170 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/nvme1n1 a6cdf3148c570061c8d3 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:45.170 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/nvme2n1 714150320111a5a24314 Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:45.171 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/nvme3n1 ecfd8fce982a0777d53f Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:45.171 INFO:teuthology.orchestra.run.smithi191.stdout:/dev/nvme4n1 8a2ef2044beeb954d62a Linux 1 96.00 GB / 96.00 GB 512 B + 0 B 4.18.0-4 2022-11-29T17:00:45.172 INFO:tasks.nvme_loop:new_devs ['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2022-11-29T17:00:45.172 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:00:45.173 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/scratch_devs 2022-11-29T17:00:45.240 INFO:teuthology.run_tasks:Running task pexec... 2022-11-29T17:00:45.260 INFO:teuthology.task.pexec:Executing custom commands... 2022-11-29T17:00:45.261 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi182.front.sepia.ceph.com 2022-11-29T17:00:45.262 DEBUG:teuthology.orchestra.run.smithi182:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-11-29T17:00:45.263 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi191.front.sepia.ceph.com 2022-11-29T17:00:45.263 DEBUG:teuthology.orchestra.run.smithi191:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-11-29T17:00:45.897 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:01:25 ago on Tue 29 Nov 2022 04:59:20 PM UTC. 2022-11-29T17:00:45.914 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:26 ago on Tue 29 Nov 2022 04:59:19 PM UTC. 2022-11-29T17:00:47.275 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-11-29T17:00:47.276 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T17:00:47.277 INFO:teuthology.orchestra.run.smithi182.stdout: Package Architecture Version Repository Size 2022-11-29T17:00:47.277 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T17:00:47.277 INFO:teuthology.orchestra.run.smithi182.stdout:Resetting modules: 2022-11-29T17:00:47.277 INFO:teuthology.orchestra.run.smithi182.stdout: container-tools 2022-11-29T17:00:47.278 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:47.278 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2022-11-29T17:00:47.278 INFO:teuthology.orchestra.run.smithi182.stdout:================================================================================ 2022-11-29T17:00:47.278 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:47.282 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-11-29T17:00:47.283 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T17:00:47.283 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-11-29T17:00:47.283 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T17:00:47.283 INFO:teuthology.orchestra.run.smithi191.stdout:Resetting modules: 2022-11-29T17:00:47.284 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools 2022-11-29T17:00:47.284 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:47.284 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-11-29T17:00:47.284 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-11-29T17:00:47.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:47.489 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-11-29T17:00:47.501 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-11-29T17:00:48.132 INFO:teuthology.orchestra.run.smithi182.stdout:Last metadata expiration check: 0:01:28 ago on Tue 29 Nov 2022 04:59:20 PM UTC. 2022-11-29T17:00:48.153 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:29 ago on Tue 29 Nov 2022 04:59:19 PM UTC. 2022-11-29T17:00:49.479 INFO:teuthology.orchestra.run.smithi182.stdout:Dependencies resolved. 2022-11-29T17:00:49.481 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================= 2022-11-29T17:00:49.481 INFO:teuthology.orchestra.run.smithi182.stdout: Package Arch Version Repository Size 2022-11-29T17:00:49.481 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================= 2022-11-29T17:00:49.482 INFO:teuthology.orchestra.run.smithi182.stdout:Installing group/module packages: 2022-11-29T17:00:49.482 INFO:teuthology.orchestra.run.smithi182.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2022-11-29T17:00:49.482 INFO:teuthology.orchestra.run.smithi182.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2022-11-29T17:00:49.483 INFO:teuthology.orchestra.run.smithi182.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2022-11-29T17:00:49.483 INFO:teuthology.orchestra.run.smithi182.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2022-11-29T17:00:49.484 INFO:teuthology.orchestra.run.smithi182.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2022-11-29T17:00:49.484 INFO:teuthology.orchestra.run.smithi182.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2022-11-29T17:00:49.484 INFO:teuthology.orchestra.run.smithi182.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2022-11-29T17:00:49.485 INFO:teuthology.orchestra.run.smithi182.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-11-29T17:00:49.485 INFO:teuthology.orchestra.run.smithi182.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2022-11-29T17:00:49.486 INFO:teuthology.orchestra.run.smithi182.stdout:Installing dependencies: 2022-11-29T17:00:49.486 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-11-29T17:00:49.486 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-11-29T17:00:49.486 INFO:teuthology.orchestra.run.smithi182.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2022-11-29T17:00:49.487 INFO:teuthology.orchestra.run.smithi182.stdout:Installing module profiles: 2022-11-29T17:00:49.487 INFO:teuthology.orchestra.run.smithi182.stdout: container-tools/common 2022-11-29T17:00:49.487 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:49.487 INFO:teuthology.orchestra.run.smithi182.stdout:Enabling module streams: 2022-11-29T17:00:49.487 INFO:teuthology.orchestra.run.smithi182.stdout: container-tools rhel8 2022-11-29T17:00:49.488 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:49.488 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction Summary 2022-11-29T17:00:49.488 INFO:teuthology.orchestra.run.smithi182.stdout:========================================================================================= 2022-11-29T17:00:49.488 INFO:teuthology.orchestra.run.smithi182.stdout:Install 12 Packages 2022-11-29T17:00:49.489 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:49.489 INFO:teuthology.orchestra.run.smithi182.stdout:Total download size: 21 M 2022-11-29T17:00:49.490 INFO:teuthology.orchestra.run.smithi182.stdout:Installed size: 71 M 2022-11-29T17:00:49.490 INFO:teuthology.orchestra.run.smithi182.stdout:Downloading Packages: 2022-11-29T17:00:49.501 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-11-29T17:00:49.502 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-11-29T17:00:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-11-29T17:00:49.503 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-11-29T17:00:49.503 INFO:teuthology.orchestra.run.smithi191.stdout:Installing group/module packages: 2022-11-29T17:00:49.503 INFO:teuthology.orchestra.run.smithi191.stdout: aardvark-dns x86_64 2:1.1.0-4.module_el8.7.0+1216+b022c01d CentOS-AppStream 997 k 2022-11-29T17:00:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: buildah x86_64 1:1.27.0-2.module_el8.7.0+1216+b022c01d CentOS-AppStream 8.1 M 2022-11-29T17:00:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: cockpit-podman noarch 53-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 547 k 2022-11-29T17:00:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: crun x86_64 1.5-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 213 k 2022-11-29T17:00:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: netavark x86_64 2:1.1.0-6.module_el8.7.0+1216+b022c01d CentOS-AppStream 2.2 M 2022-11-29T17:00:49.504 INFO:teuthology.orchestra.run.smithi191.stdout: python3-podman noarch 4.2.0-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 151 k 2022-11-29T17:00:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: skopeo x86_64 2:1.9.2-1.module_el8.7.0+1216+b022c01d CentOS-AppStream 6.8 M 2022-11-29T17:00:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-11-29T17:00:49.505 INFO:teuthology.orchestra.run.smithi191.stdout: udica noarch 0.2.6-3.module_el8.7.0+1216+b022c01d CentOS-AppStream 49 k 2022-11-29T17:00:49.505 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-11-29T17:00:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-11-29T17:00:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-11-29T17:00:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: yajl x86_64 2.1.0-11.el8 CentOS-AppStream 41 k 2022-11-29T17:00:49.506 INFO:teuthology.orchestra.run.smithi191.stdout:Installing module profiles: 2022-11-29T17:00:49.506 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools/common 2022-11-29T17:00:49.507 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:49.507 INFO:teuthology.orchestra.run.smithi191.stdout:Enabling module streams: 2022-11-29T17:00:49.507 INFO:teuthology.orchestra.run.smithi191.stdout: container-tools rhel8 2022-11-29T17:00:49.507 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:49.507 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-11-29T17:00:49.508 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-11-29T17:00:49.508 INFO:teuthology.orchestra.run.smithi191.stdout:Install 12 Packages 2022-11-29T17:00:49.508 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:49.509 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 21 M 2022-11-29T17:00:49.509 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 71 M 2022-11-29T17:00:49.509 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-11-29T17:00:49.574 INFO:teuthology.orchestra.run.smithi182.stdout:(1/12): aardvark-dns-1.1.0-4.module_el8.7.0+121 11 MB/s | 997 kB 00:00 2022-11-29T17:00:49.607 INFO:teuthology.orchestra.run.smithi182.stdout:(2/12): crun-1.5-1.module_el8.7.0+1216+b022c01d 6.3 MB/s | 213 kB 00:00 2022-11-29T17:00:49.674 INFO:teuthology.orchestra.run.smithi182.stdout:(3/12): cockpit-podman-53-1.module_el8.7.0+1216 2.8 MB/s | 547 kB 00:00 2022-11-29T17:00:49.708 INFO:teuthology.orchestra.run.smithi182.stdout:(4/12): python3-podman-4.2.0-1.module_el8.7.0+1 4.4 MB/s | 151 kB 00:00 2022-11-29T17:00:49.733 INFO:teuthology.orchestra.run.smithi182.stdout:(5/12): python3-pytoml-0.1.14-5.git7dea353.el8. 1.0 MB/s | 25 kB 00:00 2022-11-29T17:00:49.753 INFO:teuthology.orchestra.run.smithi191.stdout:(1/12): buildah-1.27.0-2.module_el8.7.0+1216+b0 33 MB/s | 8.1 MB 00:00 2022-11-29T17:00:49.758 INFO:teuthology.orchestra.run.smithi182.stdout:(6/12): python3-pyxdg-0.25-16.el8.noarch.rpm 3.7 MB/s | 94 kB 00:00 2022-11-29T17:00:49.778 INFO:teuthology.orchestra.run.smithi191.stdout:(2/12): crun-1.5-1.module_el8.7.0+1216+b022c01d 8.4 MB/s | 213 kB 00:00 2022-11-29T17:00:49.803 INFO:teuthology.orchestra.run.smithi191.stdout:(3/12): cockpit-podman-53-1.module_el8.7.0+1216 1.8 MB/s | 547 kB 00:00 2022-11-29T17:00:49.825 INFO:teuthology.orchestra.run.smithi182.stdout:(7/12): netavark-1.1.0-6.module_el8.7.0+1216+b0 9.9 MB/s | 2.2 MB 00:00 2022-11-29T17:00:49.846 INFO:teuthology.orchestra.run.smithi191.stdout:(4/12): aardvark-dns-1.1.0-4.module_el8.7.0+121 2.9 MB/s | 997 kB 00:00 2022-11-29T17:00:49.904 INFO:teuthology.orchestra.run.smithi191.stdout:(5/12): python3-podman-4.2.0-1.module_el8.7.0+1 1.5 MB/s | 151 kB 00:00 2022-11-29T17:00:49.926 INFO:teuthology.orchestra.run.smithi182.stdout:(8/12): toolbox-0.0.99.3-1.module_el8.5.0+877+1 23 MB/s | 2.3 MB 00:00 2022-11-29T17:00:49.929 INFO:teuthology.orchestra.run.smithi191.stdout:(6/12): python3-pytoml-0.1.14-5.git7dea353.el8. 296 kB/s | 25 kB 00:00 2022-11-29T17:00:49.951 INFO:teuthology.orchestra.run.smithi182.stdout:(9/12): udica-0.2.6-3.module_el8.7.0+1216+b022c 1.9 MB/s | 49 kB 00:00 2022-11-29T17:00:49.955 INFO:teuthology.orchestra.run.smithi191.stdout:(7/12): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2022-11-29T17:00:49.976 INFO:teuthology.orchestra.run.smithi182.stdout:(10/12): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2022-11-29T17:00:50.005 INFO:teuthology.orchestra.run.smithi191.stdout:(8/12): netavark-1.1.0-6.module_el8.7.0+1216+b0 9.5 MB/s | 2.2 MB 00:00 2022-11-29T17:00:50.038 INFO:teuthology.orchestra.run.smithi191.stdout:(9/12): udica-0.2.6-3.module_el8.7.0+1216+b022c 1.4 MB/s | 49 kB 00:00 2022-11-29T17:00:50.064 INFO:teuthology.orchestra.run.smithi191.stdout:(10/12): yajl-2.1.0-11.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2022-11-29T17:00:50.148 INFO:teuthology.orchestra.run.smithi191.stdout:(11/12): toolbox-0.0.99.3-1.module_el8.5.0+877+ 12 MB/s | 2.3 MB 00:00 2022-11-29T17:00:50.151 INFO:teuthology.orchestra.run.smithi182.stdout:(11/12): buildah-1.27.0-2.module_el8.7.0+1216+b 12 MB/s | 8.1 MB 00:00 2022-11-29T17:00:50.277 INFO:teuthology.orchestra.run.smithi182.stdout:(12/12): skopeo-1.9.2-1.module_el8.7.0+1216+b02 13 MB/s | 6.8 MB 00:00 2022-11-29T17:00:50.279 INFO:teuthology.orchestra.run.smithi182.stdout:-------------------------------------------------------------------------------- 2022-11-29T17:00:50.279 INFO:teuthology.orchestra.run.smithi182.stdout:Total 27 MB/s | 21 MB 00:00 2022-11-29T17:00:50.305 INFO:teuthology.orchestra.run.smithi191.stdout:(12/12): skopeo-1.9.2-1.module_el8.7.0+1216+b02 18 MB/s | 6.8 MB 00:00 2022-11-29T17:00:50.307 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-11-29T17:00:50.308 INFO:teuthology.orchestra.run.smithi191.stdout:Total 27 MB/s | 21 MB 00:00 2022-11-29T17:00:50.505 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction check 2022-11-29T17:00:50.525 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction check succeeded. 2022-11-29T17:00:50.526 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction test 2022-11-29T17:00:50.531 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-11-29T17:00:50.551 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-11-29T17:00:50.552 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-11-29T17:00:50.749 INFO:teuthology.orchestra.run.smithi182.stdout:Transaction test succeeded. 2022-11-29T17:00:50.752 INFO:teuthology.orchestra.run.smithi182.stdout:Running transaction 2022-11-29T17:00:50.781 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-11-29T17:00:50.784 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-11-29T17:00:51.319 INFO:teuthology.orchestra.run.smithi182.stdout: Preparing : 1/1 2022-11-29T17:00:51.352 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-11-29T17:00:51.492 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : yajl-2.1.0-11.el8.x86_64 1/12 2022-11-29T17:00:51.515 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : yajl-2.1.0-11.el8.x86_64 1/12 2022-11-29T17:00:51.662 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/12 2022-11-29T17:00:51.693 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/12 2022-11-29T17:00:51.905 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/12 2022-11-29T17:00:51.937 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/12 2022-11-29T17:00:52.286 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 4/12 2022-11-29T17:00:52.320 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 4/12 2022-11-29T17:00:53.142 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/12 2022-11-29T17:00:53.214 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/12 2022-11-29T17:00:53.403 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 6/12 2022-11-29T17:00:53.433 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 6/12 2022-11-29T17:00:53.597 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 7/12 2022-11-29T17:00:53.645 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 7/12 2022-11-29T17:00:53.774 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 8/12 2022-11-29T17:00:53.797 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 8/12 2022-11-29T17:00:54.125 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 9/12 2022-11-29T17:00:54.153 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 9/12 2022-11-29T17:00:54.858 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/12 2022-11-29T17:00:54.865 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/12 2022-11-29T17:00:55.062 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 11/12 2022-11-29T17:00:55.063 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 11/12 2022-11-29T17:00:55.216 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 12/12 2022-11-29T17:00:55.218 INFO:teuthology.orchestra.run.smithi182.stdout: Installing : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 12/12 2022-11-29T17:00:55.490 INFO:teuthology.orchestra.run.smithi182.stdout: Running scriptlet: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 12/12 2022-11-29T17:00:55.491 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/12 2022-11-29T17:00:55.491 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/12 2022-11-29T17:00:55.491 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/12 2022-11-29T17:00:55.491 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/12 2022-11-29T17:00:55.492 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/12 2022-11-29T17:00:55.492 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/12 2022-11-29T17:00:55.492 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/12 2022-11-29T17:00:55.492 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/12 2022-11-29T17:00:55.493 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/12 2022-11-29T17:00:55.493 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/12 2022-11-29T17:00:55.493 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/12 2022-11-29T17:00:55.495 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 12/12 2022-11-29T17:00:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01 1/12 2022-11-29T17:00:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x8 2/12 2022-11-29T17:00:55.496 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.n 3/12 2022-11-29T17:00:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 4/12 2022-11-29T17:00:55.500 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x8 5/12 2022-11-29T17:00:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01 6/12 2022-11-29T17:00:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 7/12 2022-11-29T17:00:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 8/12 2022-11-29T17:00:55.501 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_ 9/12 2022-11-29T17:00:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 10/12 2022-11-29T17:00:55.502 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 11/12 2022-11-29T17:00:55.992 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/12 2022-11-29T17:00:55.993 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:55.993 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-11-29T17:00:55.993 INFO:teuthology.orchestra.run.smithi191.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:55.993 INFO:teuthology.orchestra.run.smithi191.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:55.994 INFO:teuthology.orchestra.run.smithi191.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:55.994 INFO:teuthology.orchestra.run.smithi191.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:55.994 INFO:teuthology.orchestra.run.smithi191.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:55.994 INFO:teuthology.orchestra.run.smithi191.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:55.994 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-11-29T17:00:55.995 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-11-29T17:00:55.995 INFO:teuthology.orchestra.run.smithi191.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:55.995 INFO:teuthology.orchestra.run.smithi191.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-11-29T17:00:55.995 INFO:teuthology.orchestra.run.smithi191.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:55.996 INFO:teuthology.orchestra.run.smithi191.stdout: yajl-2.1.0-11.el8.x86_64 2022-11-29T17:00:55.996 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:00:55.996 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-11-29T17:00:56.011 INFO:teuthology.orchestra.run.smithi182.stdout: Verifying : yajl-2.1.0-11.el8.x86_64 12/12 2022-11-29T17:00:56.012 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:56.012 INFO:teuthology.orchestra.run.smithi182.stdout:Installed: 2022-11-29T17:00:56.012 INFO:teuthology.orchestra.run.smithi182.stdout: aardvark-dns-2:1.1.0-4.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:56.012 INFO:teuthology.orchestra.run.smithi182.stdout: buildah-1:1.27.0-2.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:56.012 INFO:teuthology.orchestra.run.smithi182.stdout: cockpit-podman-53-1.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:56.013 INFO:teuthology.orchestra.run.smithi182.stdout: crun-1.5-1.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:56.013 INFO:teuthology.orchestra.run.smithi182.stdout: netavark-2:1.1.0-6.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:56.013 INFO:teuthology.orchestra.run.smithi182.stdout: python3-podman-4.2.0-1.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:56.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-11-29T17:00:56.014 INFO:teuthology.orchestra.run.smithi182.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-11-29T17:00:56.014 INFO:teuthology.orchestra.run.smithi182.stdout: skopeo-2:1.9.2-1.module_el8.7.0+1216+b022c01d.x86_64 2022-11-29T17:00:56.014 INFO:teuthology.orchestra.run.smithi182.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-11-29T17:00:56.015 INFO:teuthology.orchestra.run.smithi182.stdout: udica-0.2.6-3.module_el8.7.0+1216+b022c01d.noarch 2022-11-29T17:00:56.015 INFO:teuthology.orchestra.run.smithi182.stdout: yajl-2.1.0-11.el8.x86_64 2022-11-29T17:00:56.015 INFO:teuthology.orchestra.run.smithi182.stdout: 2022-11-29T17:00:56.015 INFO:teuthology.orchestra.run.smithi182.stdout:Complete! 2022-11-29T17:00:56.218 DEBUG:teuthology.parallel:result is None 2022-11-29T17:00:56.221 DEBUG:teuthology.parallel:result is None 2022-11-29T17:00:56.221 INFO:teuthology.run_tasks:Running task cephadm... 2022-11-29T17:00:56.305 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '8dc57b5624d909c1714a82ba84ff24e49431ea76'} 2022-11-29T17:00:56.306 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 2022-11-29T17:00:56.307 INFO:tasks.cephadm:Cluster fsid is 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:00:56.308 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2022-11-29T17:00:56.309 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.182', 'mon.c': '[v2:172.21.15.182:3301,v1:172.21.15.182:6790]', 'mon.b': '172.21.15.191'} 2022-11-29T17:00:56.309 INFO:tasks.cephadm:First mon is mon.a on smithi182 2022-11-29T17:00:56.309 INFO:tasks.cephadm:First mgr is y 2022-11-29T17:00:56.310 INFO:tasks.cephadm:Normalizing hostnames... 2022-11-29T17:00:56.310 DEBUG:teuthology.orchestra.run.smithi182:> sudo hostname $(hostname -s) 2022-11-29T17:00:56.338 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname $(hostname -s) 2022-11-29T17:00:56.367 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph-ci.git ref 8dc57b5624d909c1714a82ba84ff24e49431ea76)... 2022-11-29T17:00:56.369 DEBUG:teuthology.orchestra.run.smithi182:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/8dc57b5624d909c1714a82ba84ff24e49431ea76/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.719 INFO:teuthology.orchestra.run.smithi182.stdout:-rw-rw-r--. 1 ubuntu ubuntu 343627 Nov 29 17:00 /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.720 DEBUG:teuthology.orchestra.run.smithi191:> curl --silent https://raw.githubusercontent.com/ceph/ceph-ci/8dc57b5624d909c1714a82ba84ff24e49431ea76/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.867 INFO:teuthology.orchestra.run.smithi191.stdout:-rw-rw-r--. 1 ubuntu ubuntu 343627 Nov 29 17:00 /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.867 DEBUG:teuthology.orchestra.run.smithi182:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.887 DEBUG:teuthology.orchestra.run.smithi191:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-11-29T17:00:56.930 DEBUG:teuthology.orchestra.run.smithi182:> sudo mkdir -p /etc/ceph 2022-11-29T17:00:56.959 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph 2022-11-29T17:00:56.987 DEBUG:teuthology.orchestra.run.smithi182:> sudo chmod 777 /etc/ceph 2022-11-29T17:00:57.027 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /etc/ceph 2022-11-29T17:00:57.055 INFO:tasks.cephadm:Writing seed config... 2022-11-29T17:00:57.057 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2022-11-29T17:00:57.058 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2022-11-29T17:00:57.058 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2022-11-29T17:00:57.058 INFO:tasks.cephadm: override: [mon] debug mon = 20 2022-11-29T17:00:57.059 INFO:tasks.cephadm: override: [mon] debug ms = 1 2022-11-29T17:00:57.059 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2022-11-29T17:00:57.059 INFO:tasks.cephadm: override: [osd] debug ms = 1 2022-11-29T17:00:57.060 INFO:tasks.cephadm: override: [osd] debug osd = 20 2022-11-29T17:00:57.060 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2022-11-29T17:00:57.061 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:00:57.062 DEBUG:teuthology.orchestra.run.smithi182:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2022-11-29T17:00:57.085 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 63fec4cc-7007-11ed-843b-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2022-11-29T17:00:57.086 DEBUG:teuthology.orchestra.run.smithi182:mon.a> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.a.service 2022-11-29T17:00:57.128 DEBUG:teuthology.orchestra.run.smithi182:mgr.y> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mgr.y.service 2022-11-29T17:00:57.153 INFO:journalctl@ceph.mon.a.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:00:57.154 INFO:tasks.cephadm:Bootstrapping... 2022-11-29T17:00:57.155 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 -v bootstrap --fsid 63fec4cc-7007-11ed-843b-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.182 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2022-11-29T17:00:57.179 INFO:journalctl@ceph.mgr.y.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:00:57.448 INFO:teuthology.orchestra.run.smithi182.stderr:-------------------------------------------------------------------------------- 2022-11-29T17:00:57.449 INFO:teuthology.orchestra.run.smithi182.stderr:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76', '-v', 'bootstrap', '--fsid', '63fec4cc-7007-11ed-843b-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.182', '--skip-admin-label'] 2022-11-29T17:00:59.037 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: 4.2.0 2022-11-29T17:00:59.095 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying podman|docker is present... 2022-11-29T17:00:59.130 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: 4.2.0 2022-11-29T17:00:59.242 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying lvm2 is present... 2022-11-29T17:00:59.242 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying time synchronization is in place... 2022-11-29T17:00:59.249 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-11-29T17:00:59.256 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:00:59.262 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: enabled 2022-11-29T17:00:59.268 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: active 2022-11-29T17:00:59.269 INFO:teuthology.orchestra.run.smithi182.stderr:Unit chronyd.service is enabled and running 2022-11-29T17:00:59.269 INFO:teuthology.orchestra.run.smithi182.stderr:Repeating the final host check... 2022-11-29T17:00:59.300 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: 4.2.0 2022-11-29T17:00:59.408 INFO:teuthology.orchestra.run.smithi182.stderr:podman (/bin/podman) version 4.2.0 is present 2022-11-29T17:00:59.408 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl is present 2022-11-29T17:00:59.409 INFO:teuthology.orchestra.run.smithi182.stderr:lvcreate is present 2022-11-29T17:00:59.414 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-11-29T17:00:59.420 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:00:59.426 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: enabled 2022-11-29T17:00:59.432 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: active 2022-11-29T17:00:59.433 INFO:teuthology.orchestra.run.smithi182.stderr:Unit chronyd.service is enabled and running 2022-11-29T17:00:59.433 INFO:teuthology.orchestra.run.smithi182.stderr:Host looks OK 2022-11-29T17:00:59.433 INFO:teuthology.orchestra.run.smithi182.stderr:Cluster fsid: 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:00:59.434 INFO:teuthology.orchestra.run.smithi182.stderr:Acquiring lock 139782041657472 on /run/cephadm/63fec4cc-7007-11ed-843b-001a4aab830c.lock 2022-11-29T17:00:59.434 INFO:teuthology.orchestra.run.smithi182.stderr:Lock 139782041657472 acquired on /run/cephadm/63fec4cc-7007-11ed-843b-001a4aab830c.lock 2022-11-29T17:00:59.434 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying IP 172.21.15.182 port 3300 ... 2022-11-29T17:00:59.435 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying IP 172.21.15.182 port 6789 ... 2022-11-29T17:00:59.435 INFO:teuthology.orchestra.run.smithi182.stderr:Base mon IP(s) is [172.21.15.182:3300, 172.21.15.182:6789], mon addrv is [v2:172.21.15.182:3300,v1:172.21.15.182:6789] 2022-11-29T17:00:59.437 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.182 metric 100 2022-11-29T17:00:59.437 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.182 metric 100 2022-11-29T17:00:59.439 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2022-11-29T17:00:59.440 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2022-11-29T17:00:59.440 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2022-11-29T17:00:59.442 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2022-11-29T17:00:59.442 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: inet6 ::1/128 scope host 2022-11-29T17:00:59.443 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-11-29T17:00:59.443 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2022-11-29T17:00:59.443 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe88:778d/64 scope link 2022-11-29T17:00:59.443 INFO:teuthology.orchestra.run.smithi182.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-11-29T17:00:59.446 INFO:teuthology.orchestra.run.smithi182.stderr:Mon IP `172.21.15.182` is in CIDR network `172.21.0.0/20` 2022-11-29T17:00:59.447 INFO:teuthology.orchestra.run.smithi182.stderr:Mon IP `172.21.15.182` is in CIDR network `172.21.0.0/20` 2022-11-29T17:00:59.447 INFO:teuthology.orchestra.run.smithi182.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2022-11-29T17:00:59.447 INFO:teuthology.orchestra.run.smithi182.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2022-11-29T17:00:59.447 INFO:teuthology.orchestra.run.smithi182.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76... 2022-11-29T17:00:59.551 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76... 2022-11-29T17:00:59.659 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Getting image source signatures 2022-11-29T17:00:59.669 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying blob sha256:4f2813a8bd221d48046d20077ea3f1f77e1b6a6164ae0b6b5f967a7a63780b84 2022-11-29T17:00:59.669 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying blob sha256:53525f8b521a5f9317c9ce853653e176e9ed1037575ae7f5da2a2bed6a450060 2022-11-29T17:00:59.670 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying blob sha256:e2873b3fbbec402bafc59c62563e7264f20ad5dccce4dae4ebfb5edd55afb4cb 2022-11-29T17:00:59.670 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying blob sha256:317bd5f21d3fa946c4fb62d54870936260c660d455fde8674fba06ae80df1cf8 2022-11-29T17:00:59.670 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying blob sha256:aa16c48af92239fef3d4f8c28b3ad613ba91dcadb275f88623c48df79127d165 2022-11-29T17:01:12.926 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Copying config sha256:36e522c82020e4940d5f709a09fba13a6f6a3802e0b070171464e928a9fd2b3c 2022-11-29T17:01:13.009 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Writing manifest to image destination 2022-11-29T17:01:13.010 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: Storing signatures 2022-11-29T17:01:13.333 INFO:teuthology.orchestra.run.smithi182.stderr:/bin/podman: 36e522c82020e4940d5f709a09fba13a6f6a3802e0b070171464e928a9fd2b3c 2022-11-29T17:01:14.078 INFO:teuthology.orchestra.run.smithi182.stderr:ceph: ceph version 16.2.10-1291-g8dc57b56 (8dc57b5624d909c1714a82ba84ff24e49431ea76) pacific (stable) 2022-11-29T17:01:14.469 INFO:teuthology.orchestra.run.smithi182.stderr:Ceph version: ceph version 16.2.10-1291-g8dc57b56 (8dc57b5624d909c1714a82ba84ff24e49431ea76) pacific (stable) 2022-11-29T17:01:14.470 INFO:teuthology.orchestra.run.smithi182.stderr:Extracting ceph user uid/gid from container image... 2022-11-29T17:01:14.825 INFO:teuthology.orchestra.run.smithi182.stderr:stat: 167 167 2022-11-29T17:01:15.213 INFO:teuthology.orchestra.run.smithi182.stderr:Creating initial keys... 2022-11-29T17:01:15.616 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-authtool: AQDbOoZj3H2hIxAA6pxbdengVoVafn6U8RMJ8Q== 2022-11-29T17:01:16.416 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-authtool: AQDcOoZjLjHoFxAAbPZI6hBSfdBzKV1jxvEKow== 2022-11-29T17:01:17.216 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-authtool: AQDdOoZjJxnqCxAAfalpmH4skLrWlnNn1640rg== 2022-11-29T17:01:17.640 INFO:teuthology.orchestra.run.smithi182.stderr:Creating initial monmap... 2022-11-29T17:01:18.007 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2022-11-29T17:01:18.008 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:18.008 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-11-29T17:01:18.379 INFO:teuthology.orchestra.run.smithi182.stderr:monmaptool for a [v2:172.21.15.182:3300,v1:172.21.15.182:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2022-11-29T17:01:18.379 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/monmaptool: set fsid to 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:18.380 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-11-29T17:01:18.380 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:01:18.381 INFO:teuthology.orchestra.run.smithi182.stderr:Creating mon... 2022-11-29T17:01:18.845 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.797+0000 7f8188b0a880 0 set uid:gid to 167:167 (ceph:ceph) 2022-11-29T17:01:18.846 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.797+0000 7f8188b0a880 1 imported monmap: 2022-11-29T17:01:18.846 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: epoch 0 2022-11-29T17:01:18.847 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: fsid 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:18.847 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: last_changed 2022-11-29T17:01:18.005066+0000 2022-11-29T17:01:18.847 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: created 2022-11-29T17:01:18.005066+0000 2022-11-29T17:01:18.848 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2022-11-29T17:01:18.848 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: election_strategy: 1 2022-11-29T17:01:18.848 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] mon.a 2022-11-29T17:01:18.849 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.849 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.797+0000 7f8188b0a880 0 /usr/bin/ceph-mon: set fsid to 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:18.849 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: RocksDB version: 6.8.1 2022-11-29T17:01:18.849 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.850 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-11-29T17:01:18.850 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Compile date Nov 28 2022 2022-11-29T17:01:18.850 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: DB SUMMARY 2022-11-29T17:01:18.850 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.851 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2022-11-29T17:01:18.851 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.851 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2022-11-29T17:01:18.851 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.852 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.error_if_exists: 0 2022-11-29T17:01:18.852 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.create_if_missing: 1 2022-11-29T17:01:18.852 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.paranoid_checks: 1 2022-11-29T17:01:18.852 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.env: 0x55917bc80000 2022-11-29T17:01:18.852 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.fs: Posix File System 2022-11-29T17:01:18.853 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.info_log: 0x55917df9d980 2022-11-29T17:01:18.853 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_file_opening_threads: 16 2022-11-29T17:01:18.853 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.statistics: (nil) 2022-11-29T17:01:18.853 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.use_fsync: 0 2022-11-29T17:01:18.854 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_log_file_size: 0 2022-11-29T17:01:18.854 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-11-29T17:01:18.854 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.log_file_time_to_roll: 0 2022-11-29T17:01:18.854 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.keep_log_file_num: 1000 2022-11-29T17:01:18.854 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.recycle_log_file_num: 0 2022-11-29T17:01:18.855 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.allow_fallocate: 1 2022-11-29T17:01:18.855 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.allow_mmap_reads: 0 2022-11-29T17:01:18.855 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.allow_mmap_writes: 0 2022-11-29T17:01:18.856 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.use_direct_reads: 0 2022-11-29T17:01:18.856 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-11-29T17:01:18.856 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.create_missing_column_families: 0 2022-11-29T17:01:18.856 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.db_log_dir: 2022-11-29T17:01:18.857 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2022-11-29T17:01:18.857 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.table_cache_numshardbits: 6 2022-11-29T17:01:18.857 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_subcompactions: 1 2022-11-29T17:01:18.857 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_background_flushes: -1 2022-11-29T17:01:18.858 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-11-29T17:01:18.858 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-11-29T17:01:18.858 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-11-29T17:01:18.859 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-11-29T17:01:18.859 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-11-29T17:01:18.859 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.advise_random_on_open: 1 2022-11-29T17:01:18.859 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.db_write_buffer_size: 0 2022-11-29T17:01:18.859 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.write_buffer_manager: 0x55917dfa5680 2022-11-29T17:01:18.860 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-11-29T17:01:18.860 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-11-29T17:01:18.860 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-11-29T17:01:18.860 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.use_adaptive_mutex: 0 2022-11-29T17:01:18.860 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.rate_limiter: (nil) 2022-11-29T17:01:18.861 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-11-29T17:01:18.861 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.wal_recovery_mode: 2 2022-11-29T17:01:18.861 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.enable_thread_tracking: 0 2022-11-29T17:01:18.861 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.enable_pipelined_write: 0 2022-11-29T17:01:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.unordered_write: 0 2022-11-29T17:01:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-11-29T17:01:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-11-29T17:01:18.862 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-11-29T17:01:18.863 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-11-29T17:01:18.863 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.row_cache: None 2022-11-29T17:01:18.863 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.wal_filter: None 2022-11-29T17:01:18.864 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-11-29T17:01:18.864 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.allow_ingest_behind: 0 2022-11-29T17:01:18.864 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.preserve_deletes: 0 2022-11-29T17:01:18.864 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.two_write_queues: 0 2022-11-29T17:01:18.865 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.manual_wal_flush: 0 2022-11-29T17:01:18.865 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.atomic_flush: 0 2022-11-29T17:01:18.865 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-11-29T17:01:18.865 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.persist_stats_to_disk: 0 2022-11-29T17:01:18.866 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-11-29T17:01:18.866 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.log_readahead_size: 0 2022-11-29T17:01:18.866 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-11-29T17:01:18.866 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_background_jobs: 2 2022-11-29T17:01:18.867 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_background_compactions: -1 2022-11-29T17:01:18.867 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-11-29T17:01:18.867 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-11-29T17:01:18.867 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.delayed_write_rate : 16777216 2022-11-29T17:01:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_total_wal_size: 0 2022-11-29T17:01:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-11-29T17:01:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.stats_dump_period_sec: 600 2022-11-29T17:01:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.stats_persist_period_sec: 600 2022-11-29T17:01:18.868 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-11-29T17:01:18.869 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.max_open_files: -1 2022-11-29T17:01:18.869 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.bytes_per_sync: 0 2022-11-29T17:01:18.869 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-11-29T17:01:18.869 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-11-29T17:01:18.869 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Options.compaction_readahead_size: 0 2022-11-29T17:01:18.870 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Compression algorithms supported: 2022-11-29T17:01:18.870 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-11-29T17:01:18.870 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kZSTD supported: 0 2022-11-29T17:01:18.870 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kXpressCompression supported: 0 2022-11-29T17:01:18.870 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kLZ4HCCompression supported: 1 2022-11-29T17:01:18.871 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kLZ4Compression supported: 1 2022-11-29T17:01:18.871 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kBZip2Compression supported: 0 2022-11-29T17:01:18.871 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kZlibCompression supported: 1 2022-11-29T17:01:18.871 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: kSnappyCompression supported: 1 2022-11-29T17:01:18.871 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-11-29T17:01:18.872 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.798+0000 7f8188b0a880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2022-11-29T17:01:18.872 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.872 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2022-11-29T17:01:18.872 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.872 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-11-29T17:01:18.873 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.873 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-11-29T17:01:18.873 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.merge_operator: 2022-11-29T17:01:18.873 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_filter: None 2022-11-29T17:01:18.873 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_filter_factory: None 2022-11-29T17:01:18.874 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-11-29T17:01:18.874 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.table_factory: BlockBasedTable 2022-11-29T17:01:18.874 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55917deafd00) 2022-11-29T17:01:18.874 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2022-11-29T17:01:18.875 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2022-11-29T17:01:18.875 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2022-11-29T17:01:18.875 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2022-11-29T17:01:18.875 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: index_type: 0 2022-11-29T17:01:18.875 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2022-11-29T17:01:18.876 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: index_shortening: 1 2022-11-29T17:01:18.876 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2022-11-29T17:01:18.876 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2022-11-29T17:01:18.876 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: checksum: 1 2022-11-29T17:01:18.876 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2022-11-29T17:01:18.877 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_cache: 0x55917dee8d10 2022-11-29T17:01:18.877 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2022-11-29T17:01:18.877 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_cache_options: 2022-11-29T17:01:18.877 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: capacity : 536870912 2022-11-29T17:01:18.877 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2022-11-29T17:01:18.878 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2022-11-29T17:01:18.878 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2022-11-29T17:01:18.878 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2022-11-29T17:01:18.878 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2022-11-29T17:01:18.878 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_size: 4096 2022-11-29T17:01:18.879 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2022-11-29T17:01:18.879 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2022-11-29T17:01:18.879 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2022-11-29T17:01:18.879 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2022-11-29T17:01:18.879 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: partition_filters: 0 2022-11-29T17:01:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2022-11-29T17:01:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2022-11-29T17:01:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2022-11-29T17:01:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: verify_compression: 0 2022-11-29T17:01:18.880 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2022-11-29T17:01:18.881 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: format_version: 2 2022-11-29T17:01:18.881 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2022-11-29T17:01:18.881 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: block_align: 0 2022-11-29T17:01:18.881 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.882 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.write_buffer_size: 33554432 2022-11-29T17:01:18.882 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_write_buffer_number: 2 2022-11-29T17:01:18.882 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression: NoCompression 2022-11-29T17:01:18.882 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression: Disabled 2022-11-29T17:01:18.882 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.prefix_extractor: nullptr 2022-11-29T17:01:18.883 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-11-29T17:01:18.883 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.num_levels: 7 2022-11-29T17:01:18.883 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-11-29T17:01:18.883 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-11-29T17:01:18.883 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-11-29T17:01:18.884 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-11-29T17:01:18.884 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-11-29T17:01:18.884 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-11-29T17:01:18.884 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-11-29T17:01:18.884 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:01:18.885 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-11-29T17:01:18.885 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.window_bits: -14 2022-11-29T17:01:18.885 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.level: 32767 2022-11-29T17:01:18.885 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.strategy: 0 2022-11-29T17:01:18.885 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-11-29T17:01:18.886 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:01:18.886 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compression_opts.enabled: false 2022-11-29T17:01:18.886 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-11-29T17:01:18.886 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-11-29T17:01:18.886 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-11-29T17:01:18.887 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.target_file_size_base: 67108864 2022-11-29T17:01:18.887 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.target_file_size_multiplier: 1 2022-11-29T17:01:18.887 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-11-29T17:01:18.887 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-11-29T17:01:18.888 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-11-29T17:01:18.888 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-11-29T17:01:18.888 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-11-29T17:01:18.888 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-11-29T17:01:18.888 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-11-29T17:01:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-11-29T17:01:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-11-29T17:01:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-11-29T17:01:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-11-29T17:01:18.889 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-11-29T17:01:18.890 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.arena_block_size: 4194304 2022-11-29T17:01:18.890 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-11-29T17:01:18.890 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-11-29T17:01:18.890 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-11-29T17:01:18.890 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.disable_auto_compactions: 0 2022-11-29T17:01:18.891 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-11-29T17:01:18.891 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-11-29T17:01:18.891 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-11-29T17:01:18.891 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-11-29T17:01:18.891 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-11-29T17:01:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-11-29T17:01:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-11-29T17:01:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-11-29T17:01:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-11-29T17:01:18.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-11-29T17:01:18.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.table_properties_collectors: 2022-11-29T17:01:18.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.inplace_update_support: 0 2022-11-29T17:01:18.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-11-29T17:01:18.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-11-29T17:01:18.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-11-29T17:01:18.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.memtable_huge_page_size: 0 2022-11-29T17:01:18.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.bloom_locality: 0 2022-11-29T17:01:18.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.max_successive_merges: 0 2022-11-29T17:01:18.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-11-29T17:01:18.895 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.paranoid_file_checks: 0 2022-11-29T17:01:18.895 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.force_consistency_checks: 0 2022-11-29T17:01:18.895 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.report_bg_io_stats: 0 2022-11-29T17:01:18.895 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.ttl: 2592000 2022-11-29T17:01:18.895 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.799+0000 7f8188b0a880 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-11-29T17:01:18.896 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.800+0000 7f8188b0a880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-11-29T17:01:18.896 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.896 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.800+0000 7f8188b0a880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-11-29T17:01:18.896 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.896 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.800+0000 7f8188b0a880 4 rocksdb: DB pointer 0x55917dfb3800 2022-11-29T17:01:18.897 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.801+0000 7f817199d700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-11-29T17:01:18.897 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.801+0000 7f817199d700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-11-29T17:01:18.897 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2022-11-29T17:01:18.897 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:18.897 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-11-29T17:01:18.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-11-29T17:01:18.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:01:18.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-11-29T17:01:18.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-11-29T17:01:18.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:01:18.899 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.899 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-11-29T17:01:18.899 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:18.899 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:18.900 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:01:18.900 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:01:18.900 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.900 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-11-29T17:01:18.900 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:18.901 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:01:18.902 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:01:18.902 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:01:18.902 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:18.902 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:18.902 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:01:18.903 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.903 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:01:18.903 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.903 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-11-29T17:01:18.904 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:18.904 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:18.904 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:01:18.904 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:01:18.904 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.905 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-11-29T17:01:18.905 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:18.905 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:18.905 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:18.905 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:18.906 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:18.906 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:01:18.906 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:01:18.906 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:01:18.907 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:18.907 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:18.907 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:01:18.907 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.907 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:01:18.908 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: 2022-11-29T17:01:18.908 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.802+0000 7f8188b0a880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2022-11-29T17:01:18.908 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.802+0000 7f8188b0a880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2022-11-29T17:01:18.908 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph-mon: debug 2022-11-29T17:01:18.802+0000 7f8188b0a880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2022-11-29T17:01:19.230 INFO:teuthology.orchestra.run.smithi182.stderr:create mon.a on 2022-11-29T17:01:19.341 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2022-11-29T17:01:19.438 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target → /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target. 2022-11-29T17:01:19.439 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target → /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target. 2022-11-29T17:01:19.641 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Failed to reset failed state of unit ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.a.service: Unit ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.a.service not loaded. 2022-11-29T17:01:19.648 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Created symlink /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target.wants/ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c@.service. 2022-11-29T17:01:19.879 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:19 smithi182 systemd[1]: Starting Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:01:20.637 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: disabled 2022-11-29T17:01:20.645 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:01:20.645 INFO:teuthology.orchestra.run.smithi182.stderr:firewalld.service is not enabled 2022-11-29T17:01:20.646 INFO:teuthology.orchestra.run.smithi182.stderr:Not possible to enable service . firewalld.service is not available 2022-11-29T17:01:20.647 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mon to start... 2022-11-29T17:01:20.648 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mon... 2022-11-29T17:01:20.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:20 smithi182 podman[100453]: 2022-11-29T17:01:20.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:20 smithi182 bash[100453]: e609df388b7f3179d9fc90a46d0490f002956f1f12973385508140485e260165 2022-11-29T17:01:20.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:20 smithi182 systemd[1]: Started Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:01:20.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.639688+0000 mon.a (mon.0) 0 : [INF] mkfs 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:20.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.622858+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2022-11-29T17:01:21.169 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: cluster: 2022-11-29T17:01:21.169 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: id: 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:21.170 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: health: HEALTH_OK 2022-11-29T17:01:21.170 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:21.170 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: services: 2022-11-29T17:01:21.170 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.525706s) 2022-11-29T17:01:21.170 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mgr: no daemons active 2022-11-29T17:01:21.171 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2022-11-29T17:01:21.171 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:21.171 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: data: 2022-11-29T17:01:21.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2022-11-29T17:01:21.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2022-11-29T17:01:21.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2022-11-29T17:01:21.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: pgs: 2022-11-29T17:01:21.173 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:21.586 INFO:teuthology.orchestra.run.smithi182.stderr:mon is available 2022-11-29T17:01:21.587 INFO:teuthology.orchestra.run.smithi182.stderr:Assimilating anything we can from ceph.conf... 2022-11-29T17:01:21.859 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.638683+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2022-11-29T17:01:21.860 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.638927+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0]} 2022-11-29T17:01:21.860 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.641109+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2022-11-29T17:01:21.861 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.647092+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-11-29T17:01:21.861 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: cluster 2022-11-29T17:01:20.647644+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2022-11-29T17:01:21.862 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: audit 2022-11-29T17:01:21.164326+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.182:0/807419676' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2022-11-29T17:01:22.138 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:22.139 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [global] 2022-11-29T17:01:22.139 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: fsid = 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:22.139 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.182:3300,v1:172.21.15.182:6789] 2022-11-29T17:01:22.139 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2022-11-29T17:01:22.140 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2022-11-29T17:01:22.140 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2022-11-29T17:01:22.140 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2022-11-29T17:01:22.140 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:22.140 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [mgr] 2022-11-29T17:01:22.141 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2022-11-29T17:01:22.141 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:22.141 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [osd] 2022-11-29T17:01:22.141 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2022-11-29T17:01:22.141 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2022-11-29T17:01:22.623 INFO:teuthology.orchestra.run.smithi182.stderr:Generating new minimal ceph.conf... 2022-11-29T17:01:22.846 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: audit 2022-11-29T17:01:22.132837+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.182:0/465764670' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-11-29T17:01:22.847 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: audit 2022-11-29T17:01:22.135518+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.182:0/465764670' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-11-29T17:01:23.658 INFO:teuthology.orchestra.run.smithi182.stderr:Restarting the monitor... 2022-11-29T17:01:24.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: audit 2022-11-29T17:01:23.158643+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.182:0/3778408250' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:01:24.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:23 smithi182 systemd[1]: Stopping Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:01:24.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:23 smithi182 bash[100802]: Error: no container with name or ID "ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon.a" found: no such container 2022-11-29T17:01:24.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: debug 2022-11-29T17:01:23.793+0000 7f2a465c7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-11-29T17:01:24.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100469]: debug 2022-11-29T17:01:23.793+0000 7f2a465c7700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2022-11-29T17:01:24.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 bash[100817]: ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a 2022-11-29T17:01:24.293 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 bash[100858]: Error: no container with name or ID "ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon.a" found: no such container 2022-11-29T17:01:24.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 systemd[1]: ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.a.service: Succeeded. 2022-11-29T17:01:24.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 systemd[1]: Stopped Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:01:24.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 systemd[1]: Starting Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:01:25.181 INFO:teuthology.orchestra.run.smithi182.stderr:Setting mon public_network to 172.21.0.0/20 2022-11-29T17:01:25.258 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:24 smithi182 podman[100934]: 2022-11-29T17:01:25.259 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 bash[100934]: 15028c2c37e3fb0facaa4ab341f322b23f132a6a3d35118ef75e56b24e7bbe40 2022-11-29T17:01:25.259 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.165+0000 7fa65e194880 0 set uid:gid to 167:167 (ceph:ceph) 2022-11-29T17:01:25.259 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.165+0000 7fa65e194880 0 ceph version 16.2.10-1291-g8dc57b56 (8dc57b5624d909c1714a82ba84ff24e49431ea76) pacific (stable), process ceph-mon, pid 7 2022-11-29T17:01:25.259 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.165+0000 7fa65e194880 0 pidfile_write: ignore empty --pid-file 2022-11-29T17:01:25.260 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.169+0000 7fa65e194880 0 load: jerasure load: lrc load: isa 2022-11-29T17:01:25.260 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: RocksDB version: 6.8.1 2022-11-29T17:01:25.260 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.260 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-11-29T17:01:25.260 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Compile date Nov 28 2022 2022-11-29T17:01:25.261 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: DB SUMMARY 2022-11-29T17:01:25.261 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.261 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: CURRENT file: CURRENT 2022-11-29T17:01:25.261 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.262 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: IDENTITY file: IDENTITY 2022-11-29T17:01:25.262 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.262 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2022-11-29T17:01:25.262 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.262 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2022-11-29T17:01:25.263 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.263 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 86051 ; 2022-11-29T17:01:25.263 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.263 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.error_if_exists: 0 2022-11-29T17:01:25.264 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.create_if_missing: 0 2022-11-29T17:01:25.264 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.paranoid_checks: 1 2022-11-29T17:01:25.264 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.env: 0x559d2a868000 2022-11-29T17:01:25.264 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.fs: Posix File System 2022-11-29T17:01:25.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.info_log: 0x559d2d07f8a0 2022-11-29T17:01:25.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_file_opening_threads: 16 2022-11-29T17:01:25.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.statistics: (nil) 2022-11-29T17:01:25.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.use_fsync: 0 2022-11-29T17:01:25.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_log_file_size: 0 2022-11-29T17:01:25.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-11-29T17:01:25.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.log_file_time_to_roll: 0 2022-11-29T17:01:25.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.keep_log_file_num: 1000 2022-11-29T17:01:25.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.recycle_log_file_num: 0 2022-11-29T17:01:25.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.allow_fallocate: 1 2022-11-29T17:01:25.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.allow_mmap_reads: 0 2022-11-29T17:01:25.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.allow_mmap_writes: 0 2022-11-29T17:01:25.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.use_direct_reads: 0 2022-11-29T17:01:25.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-11-29T17:01:25.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.create_missing_column_families: 0 2022-11-29T17:01:25.270 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.db_log_dir: 2022-11-29T17:01:25.270 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2022-11-29T17:01:25.270 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.table_cache_numshardbits: 6 2022-11-29T17:01:25.270 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_subcompactions: 1 2022-11-29T17:01:25.270 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_background_flushes: -1 2022-11-29T17:01:25.271 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-11-29T17:01:25.271 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-11-29T17:01:25.271 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-11-29T17:01:25.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-11-29T17:01:25.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-11-29T17:01:25.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.advise_random_on_open: 1 2022-11-29T17:01:25.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.db_write_buffer_size: 0 2022-11-29T17:01:25.273 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.write_buffer_manager: 0x559d2dd7a0c0 2022-11-29T17:01:25.273 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-11-29T17:01:25.273 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-11-29T17:01:25.273 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-11-29T17:01:25.273 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.use_adaptive_mutex: 0 2022-11-29T17:01:25.274 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.rate_limiter: (nil) 2022-11-29T17:01:25.274 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-11-29T17:01:25.274 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.wal_recovery_mode: 2 2022-11-29T17:01:25.274 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.enable_thread_tracking: 0 2022-11-29T17:01:25.275 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.enable_pipelined_write: 0 2022-11-29T17:01:25.275 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.unordered_write: 0 2022-11-29T17:01:25.275 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-11-29T17:01:25.275 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-11-29T17:01:25.276 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-11-29T17:01:25.276 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-11-29T17:01:25.276 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.row_cache: None 2022-11-29T17:01:25.277 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.wal_filter: None 2022-11-29T17:01:25.277 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-11-29T17:01:25.278 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.allow_ingest_behind: 0 2022-11-29T17:01:25.278 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.preserve_deletes: 0 2022-11-29T17:01:25.278 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.two_write_queues: 0 2022-11-29T17:01:25.278 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.manual_wal_flush: 0 2022-11-29T17:01:25.279 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.atomic_flush: 0 2022-11-29T17:01:25.279 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-11-29T17:01:25.279 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.persist_stats_to_disk: 0 2022-11-29T17:01:25.280 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-11-29T17:01:25.280 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.log_readahead_size: 0 2022-11-29T17:01:25.280 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-11-29T17:01:25.280 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_background_jobs: 2 2022-11-29T17:01:25.281 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_background_compactions: -1 2022-11-29T17:01:25.281 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-11-29T17:01:25.281 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-11-29T17:01:25.281 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.delayed_write_rate : 16777216 2022-11-29T17:01:25.281 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_total_wal_size: 0 2022-11-29T17:01:25.282 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-11-29T17:01:25.282 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.stats_dump_period_sec: 600 2022-11-29T17:01:25.282 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.stats_persist_period_sec: 600 2022-11-29T17:01:25.282 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-11-29T17:01:25.282 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_open_files: -1 2022-11-29T17:01:25.283 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bytes_per_sync: 0 2022-11-29T17:01:25.283 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-11-29T17:01:25.283 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-11-29T17:01:25.283 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_readahead_size: 0 2022-11-29T17:01:25.284 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Compression algorithms supported: 2022-11-29T17:01:25.284 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-11-29T17:01:25.284 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kZSTD supported: 0 2022-11-29T17:01:25.284 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kXpressCompression supported: 0 2022-11-29T17:01:25.284 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kLZ4HCCompression supported: 1 2022-11-29T17:01:25.285 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kLZ4Compression supported: 1 2022-11-29T17:01:25.285 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kBZip2Compression supported: 0 2022-11-29T17:01:25.285 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kZlibCompression supported: 1 2022-11-29T17:01:25.285 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: kSnappyCompression supported: 1 2022-11-29T17:01:25.285 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-11-29T17:01:25.286 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2022-11-29T17:01:25.286 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.286 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-11-29T17:01:25.286 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.286 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-11-29T17:01:25.287 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.merge_operator: 2022-11-29T17:01:25.287 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_filter: None 2022-11-29T17:01:25.287 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_filter_factory: None 2022-11-29T17:01:25.287 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-11-29T17:01:25.288 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.table_factory: BlockBasedTable 2022-11-29T17:01:25.288 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559d2d029cf8) 2022-11-29T17:01:25.288 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cache_index_and_filter_blocks: 1 2022-11-29T17:01:25.288 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cache_index_and_filter_blocks_with_high_priority: 0 2022-11-29T17:01:25.288 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-11-29T17:01:25.289 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: pin_top_level_index_and_filter: 1 2022-11-29T17:01:25.289 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: index_type: 0 2022-11-29T17:01:25.289 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: data_block_index_type: 0 2022-11-29T17:01:25.289 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: index_shortening: 1 2022-11-29T17:01:25.289 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: data_block_hash_table_util_ratio: 0.750000 2022-11-29T17:01:25.290 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: hash_index_allow_collision: 1 2022-11-29T17:01:25.290 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: checksum: 1 2022-11-29T17:01:25.290 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: no_block_cache: 0 2022-11-29T17:01:25.290 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_cache: 0x559d2d062f10 2022-11-29T17:01:25.290 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_cache_name: BinnedLRUCache 2022-11-29T17:01:25.291 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_cache_options: 2022-11-29T17:01:25.291 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: capacity : 536870912 2022-11-29T17:01:25.291 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: num_shard_bits : 4 2022-11-29T17:01:25.291 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: strict_capacity_limit : 0 2022-11-29T17:01:25.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: high_pri_pool_ratio: 0.000 2022-11-29T17:01:25.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_cache_compressed: (nil) 2022-11-29T17:01:25.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: persistent_cache: (nil) 2022-11-29T17:01:25.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_size: 4096 2022-11-29T17:01:25.292 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_size_deviation: 10 2022-11-29T17:01:25.293 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_restart_interval: 16 2022-11-29T17:01:25.293 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: index_block_restart_interval: 1 2022-11-29T17:01:25.293 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: metadata_block_size: 4096 2022-11-29T17:01:25.293 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: partition_filters: 0 2022-11-29T17:01:25.294 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: use_delta_encoding: 1 2022-11-29T17:01:25.294 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: filter_policy: rocksdb.BuiltinBloomFilter 2022-11-29T17:01:25.294 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: whole_key_filtering: 1 2022-11-29T17:01:25.294 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: verify_compression: 0 2022-11-29T17:01:25.295 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: read_amp_bytes_per_bit: 0 2022-11-29T17:01:25.295 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: format_version: 2 2022-11-29T17:01:25.295 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: enable_index_compression: 1 2022-11-29T17:01:25.295 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: block_align: 0 2022-11-29T17:01:25.296 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.296 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.write_buffer_size: 33554432 2022-11-29T17:01:25.296 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_write_buffer_number: 2 2022-11-29T17:01:25.296 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression: NoCompression 2022-11-29T17:01:25.296 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression: Disabled 2022-11-29T17:01:25.297 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.prefix_extractor: nullptr 2022-11-29T17:01:25.297 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-11-29T17:01:25.297 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.num_levels: 7 2022-11-29T17:01:25.297 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-11-29T17:01:25.298 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-11-29T17:01:25.298 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-11-29T17:01:25.298 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-11-29T17:01:25.298 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-11-29T17:01:25.298 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-11-29T17:01:25.299 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-11-29T17:01:25.299 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:01:25.299 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-11-29T17:01:25.299 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.window_bits: -14 2022-11-29T17:01:25.299 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.level: 32767 2022-11-29T17:01:25.300 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.strategy: 0 2022-11-29T17:01:25.300 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-11-29T17:01:25.300 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:01:25.300 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compression_opts.enabled: false 2022-11-29T17:01:25.300 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-11-29T17:01:25.301 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-11-29T17:01:25.301 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-11-29T17:01:25.301 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.target_file_size_base: 67108864 2022-11-29T17:01:25.301 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.target_file_size_multiplier: 1 2022-11-29T17:01:25.302 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-11-29T17:01:25.302 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-11-29T17:01:25.302 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-11-29T17:01:25.302 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-11-29T17:01:25.302 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-11-29T17:01:25.303 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-11-29T17:01:25.303 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-11-29T17:01:25.303 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-11-29T17:01:25.303 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-11-29T17:01:25.304 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-11-29T17:01:25.304 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-11-29T17:01:25.304 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-11-29T17:01:25.304 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.arena_block_size: 4194304 2022-11-29T17:01:25.304 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-11-29T17:01:25.305 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-11-29T17:01:25.305 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-11-29T17:01:25.305 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.disable_auto_compactions: 0 2022-11-29T17:01:25.305 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-11-29T17:01:25.306 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-11-29T17:01:25.306 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-11-29T17:01:25.306 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-11-29T17:01:25.306 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-11-29T17:01:25.306 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-11-29T17:01:25.307 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-11-29T17:01:25.307 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-11-29T17:01:25.307 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-11-29T17:01:25.307 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-11-29T17:01:25.308 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.table_properties_collectors: 2022-11-29T17:01:25.308 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.inplace_update_support: 0 2022-11-29T17:01:25.308 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-11-29T17:01:25.308 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-11-29T17:01:25.308 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-11-29T17:01:25.309 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.memtable_huge_page_size: 0 2022-11-29T17:01:25.309 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.bloom_locality: 0 2022-11-29T17:01:25.309 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.max_successive_merges: 0 2022-11-29T17:01:25.309 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-11-29T17:01:25.309 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.paranoid_file_checks: 0 2022-11-29T17:01:25.310 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.force_consistency_checks: 0 2022-11-29T17:01:25.310 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.report_bg_io_stats: 0 2022-11-29T17:01:25.310 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.170+0000 7fa65e194880 4 rocksdb: Options.ttl: 2592000 2022-11-29T17:01:25.310 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.171+0000 7fa65e194880 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-11-29T17:01:25.311 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.171+0000 7fa65e194880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-11-29T17:01:25.311 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.311 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.171+0000 7fa65e194880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2022-11-29T17:01:25.311 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.312 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.171+0000 7fa65e194880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741285171981, "job": 1, "event": "recovery_started", "log_files": [6]} 2022-11-29T17:01:25.312 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.171+0000 7fa65e194880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2022-11-29T17:01:25.312 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.172+0000 7fa65e194880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-11-29T17:01:25.312 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.172+0000 7fa65e194880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741285173179, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 82787, "table_properties": {"data_size": 81053, "index_size": 339, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9474, "raw_average_key_size": 47, "raw_value_size": 75570, "raw_average_value_size": 377, "num_data_blocks": 11, "num_entries": 200, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1669741285, "oldest_key_time": 3, "file_creation_time": 0}} 2022-11-29T17:01:25.313 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.173+0000 7fa65e194880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2022-11-29T17:01:25.313 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.313 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.173+0000 7fa65e194880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741285173730, "job": 1, "event": "recovery_finished"} 2022-11-29T17:01:25.313 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.174+0000 7fa65e194880 4 rocksdb: DB pointer 0x559d2d12d800 2022-11-29T17:01:25.313 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.174+0000 7fa644fa6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-11-29T17:01:25.314 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.174+0000 7fa644fa6700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-11-29T17:01:25.314 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** DB Stats ** 2022-11-29T17:01:25.314 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:25.314 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-11-29T17:01:25.314 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-11-29T17:01:25.315 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:01:25.315 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-11-29T17:01:25.315 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-11-29T17:01:25.315 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:01:25.316 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.316 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** Compaction Stats [default] ** 2022-11-29T17:01:25.316 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:25.316 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:25.317 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: L0 2/0 82.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.317 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Sum 2/0 82.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.317 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.318 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.318 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** Compaction Stats [default] ** 2022-11-29T17:01:25.318 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:25.318 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:25.319 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.319 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:25.319 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:25.319 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:25.320 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:01:25.320 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:01:25.320 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:01:25.320 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Cumulative compaction: 0.00 GB write, 21.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:25.320 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Interval compaction: 0.00 GB write, 21.20 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:25.321 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:01:25.321 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.321 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:01:25.321 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.321 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** Compaction Stats [default] ** 2022-11-29T17:01:25.322 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:25.322 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:25.322 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: L0 2/0 82.50 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.322 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Sum 2/0 82.50 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.322 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:01:25.323 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.323 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** Compaction Stats [default] ** 2022-11-29T17:01:25.323 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:01:25.323 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:01:25.324 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 98.4 0.00 0.00 1 0.001 0 0 2022-11-29T17:01:25.324 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:01:25.324 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:25.324 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:01:25.324 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:01:25.325 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:01:25.325 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:01:25.325 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Cumulative compaction: 0.00 GB write, 20.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:25.325 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:01:25.325 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:01:25.326 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.326 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:01:25.326 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.326 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.175+0000 7fa65e194880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] at bind addrs [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:25.327 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 1 mon.a@-1(???) e1 preinit fsid 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:25.327 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:23.158643+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.182:0/3778408250' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:01:25.327 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).mds e1 new map 2022-11-29T17:01:25.327 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).mds e1 print_map 2022-11-29T17:01:25.327 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: e1 2022-11-29T17:01:25.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: enable_multiple, ever_enabled_multiple: 1,1 2022-11-29T17:01:25.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-11-29T17:01:25.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: legacy client fscid: -1 2022-11-29T17:01:25.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.329 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: No filesystems configured 2022-11-29T17:01:25.329 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: 2022-11-29T17:01:25.329 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2022-11-29T17:01:25.329 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:01:25.329 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:01:25.330 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:01:25.330 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2022-11-29T17:01:25.330 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 4 mon.a@-1(???).mgr e0 loading version 1 2022-11-29T17:01:25.330 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 4 mon.a@-1(???).mgr e1 active server: (0) 2022-11-29T17:01:25.330 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: debug 2022-11-29T17:01:25.177+0000 7fa65e194880 4 mon.a@-1(???).mgr e1 mkfs or daemon transitioned to available, loading commands 2022-11-29T17:01:25.331 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 systemd[1]: Started Ceph mon.a for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:01:25.331 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:25.193891+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2022-11-29T17:01:25.331 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:25.193968+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0]} 2022-11-29T17:01:25.331 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:25.194376+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2022-11-29T17:01:25.331 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:25.194412+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-11-29T17:01:25.332 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:25.194819+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2022-11-29T17:01:26.121 INFO:teuthology.orchestra.run.smithi182.stderr:Wrote config to /etc/ceph/ceph.conf 2022-11-29T17:01:26.121 INFO:teuthology.orchestra.run.smithi182.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2022-11-29T17:01:26.122 INFO:teuthology.orchestra.run.smithi182.stderr:Creating mgr... 2022-11-29T17:01:26.122 INFO:teuthology.orchestra.run.smithi182.stderr:Verifying port 9283 ... 2022-11-29T17:01:26.245 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Failed to reset failed state of unit ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mgr.y.service: Unit ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mgr.y.service not loaded. 2022-11-29T17:01:26.250 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: Created symlink /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c.target.wants/ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mgr.y.service → /etc/systemd/system/ceph-63fec4cc-7007-11ed-843b-001a4aab830c@.service. 2022-11-29T17:01:26.746 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:26 smithi182 systemd[1]: Starting Ceph mgr.y for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:01:27.013 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:25.744978+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.182:0/3830514390' entity='client.admin' 2022-11-29T17:01:27.265 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 podman[101209]: 2022-11-29T17:01:27.317 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: disabled 2022-11-29T17:01:27.325 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:01:27.326 INFO:teuthology.orchestra.run.smithi182.stderr:firewalld.service is not enabled 2022-11-29T17:01:27.326 INFO:teuthology.orchestra.run.smithi182.stderr:Not possible to enable service . firewalld.service is not available 2022-11-29T17:01:27.333 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: disabled 2022-11-29T17:01:27.341 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:01:27.342 INFO:teuthology.orchestra.run.smithi182.stderr:firewalld.service is not enabled 2022-11-29T17:01:27.343 INFO:teuthology.orchestra.run.smithi182.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2022-11-29T17:01:27.343 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mgr to start... 2022-11-29T17:01:27.343 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mgr... 2022-11-29T17:01:27.571 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 bash[101209]: 076cca2084cd800bae278552c1862175558917503723ef7b98f238de6937c630 2022-11-29T17:01:27.572 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 systemd[1]: Started Ceph mgr.y for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:01:27.572 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:27.397+0000 7ff99aac4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-29T17:01:27.573 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:27.479+0000 7ff99aac4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-29T17:01:27.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:27.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:01:27.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsid": "63fec4cc-7007-11ed-843b-001a4aab830c", 2022-11-29T17:01:27.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "health": { 2022-11-29T17:01:27.967 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-11-29T17:01:27.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "checks": {}, 2022-11-29T17:01:27.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mutes": [] 2022-11-29T17:01:27.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-11-29T17:01:27.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum": [ 2022-11-29T17:01:27.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 0 2022-11-29T17:01:27.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:27.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_names": [ 2022-11-29T17:01:27.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "a" 2022-11-29T17:01:27.970 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:27.970 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_age": 2, 2022-11-29T17:01:27.970 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "monmap": { 2022-11-29T17:01:27.970 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:27.970 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-11-29T17:01:27.971 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_mons": 1 2022-11-29T17:01:27.971 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.971 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osdmap": { 2022-11-29T17:01:27.971 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:27.972 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_osds": 0, 2022-11-29T17:01:27.972 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-11-29T17:01:27.972 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-11-29T17:01:27.972 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-11-29T17:01:27.972 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-11-29T17:01:27.973 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-11-29T17:01:27.973 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.973 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgmap": { 2022-11-29T17:01:27.974 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-11-29T17:01:27.974 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-11-29T17:01:27.974 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pools": 0, 2022-11-29T17:01:27.974 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_objects": 0, 2022-11-29T17:01:27.975 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-11-29T17:01:27.975 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-11-29T17:01:27.975 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-11-29T17:01:27.976 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_total": 0 2022-11-29T17:01:27.976 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.976 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsmap": { 2022-11-29T17:01:27.977 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:27.977 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "by_rank": [], 2022-11-29T17:01:27.977 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "up:standby": 0 2022-11-29T17:01:27.977 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.977 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mgrmap": { 2022-11-29T17:01:27.978 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "available": false, 2022-11-29T17:01:27.978 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-11-29T17:01:27.978 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modules": [ 2022-11-29T17:01:27.978 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "iostat", 2022-11-29T17:01:27.978 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "nfs", 2022-11-29T17:01:27.979 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "restful" 2022-11-29T17:01:27.979 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:27.979 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:27.979 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.980 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "servicemap": { 2022-11-29T17:01:27.980 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:27.980 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modified": "2022-11-29T17:01:20.640111+0000", 2022-11-29T17:01:27.980 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:27.980 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:27.981 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "progress_events": {} 2022-11-29T17:01:27.981 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:01:28.140 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:27.954727+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.182:0/3595221861' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-11-29T17:01:28.141 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:27.868+0000 7ff99aac4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-29T17:01:28.382 INFO:teuthology.orchestra.run.smithi182.stderr:mgr not available, waiting (1/15)... 2022-11-29T17:01:28.939 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:28.643+0000 7ff99aac4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-29T17:01:28.940 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:28.726+0000 7ff99aac4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-29T17:01:28.940 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:28.936+0000 7ff99aac4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-29T17:01:30.169 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:29.872+0000 7ff99aac4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-29T17:01:30.169 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.000+0000 7ff99aac4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:01:30.169 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.078+0000 7ff99aac4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-29T17:01:30.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.166+0000 7ff99aac4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-29T17:01:30.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.360+0000 7ff99aac4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-29T17:01:30.954 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:30.954 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:01:30.954 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsid": "63fec4cc-7007-11ed-843b-001a4aab830c", 2022-11-29T17:01:30.955 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "health": { 2022-11-29T17:01:30.955 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-11-29T17:01:30.955 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "checks": {}, 2022-11-29T17:01:30.955 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mutes": [] 2022-11-29T17:01:30.956 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.956 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-11-29T17:01:30.956 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum": [ 2022-11-29T17:01:30.956 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 0 2022-11-29T17:01:30.956 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:30.957 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_names": [ 2022-11-29T17:01:30.957 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "a" 2022-11-29T17:01:30.957 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:30.957 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_age": 5, 2022-11-29T17:01:30.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "monmap": { 2022-11-29T17:01:30.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:30.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-11-29T17:01:30.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_mons": 1 2022-11-29T17:01:30.958 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osdmap": { 2022-11-29T17:01:30.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:30.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_osds": 0, 2022-11-29T17:01:30.959 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-11-29T17:01:30.960 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-11-29T17:01:30.960 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-11-29T17:01:30.960 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-11-29T17:01:30.960 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-11-29T17:01:30.961 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.961 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgmap": { 2022-11-29T17:01:30.961 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-11-29T17:01:30.961 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-11-29T17:01:30.961 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pools": 0, 2022-11-29T17:01:30.962 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_objects": 0, 2022-11-29T17:01:30.962 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-11-29T17:01:30.962 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-11-29T17:01:30.962 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-11-29T17:01:30.962 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_total": 0 2022-11-29T17:01:30.963 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.963 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsmap": { 2022-11-29T17:01:30.963 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:30.963 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "by_rank": [], 2022-11-29T17:01:30.964 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "up:standby": 0 2022-11-29T17:01:30.964 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.964 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mgrmap": { 2022-11-29T17:01:30.966 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "available": false, 2022-11-29T17:01:30.966 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-11-29T17:01:30.966 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modules": [ 2022-11-29T17:01:30.966 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "iostat", 2022-11-29T17:01:30.967 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "nfs", 2022-11-29T17:01:30.967 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "restful" 2022-11-29T17:01:30.967 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:30.967 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:30.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "servicemap": { 2022-11-29T17:01:30.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:30.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modified": "2022-11-29T17:01:20.640111+0000", 2022-11-29T17:01:30.968 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:30.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:30.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "progress_events": {} 2022-11-29T17:01:30.969 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:01:30.970 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.654+0000 7ff99aac4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-29T17:01:30.970 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:30.755+0000 7ff99aac4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-29T17:01:31.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:30.945445+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.182:0/109213159' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-11-29T17:01:31.418 INFO:teuthology.orchestra.run.smithi182.stderr:mgr not available, waiting (2/15)... 2022-11-29T17:01:31.679 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:31.503+0000 7ff99aac4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-29T17:01:31.679 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:31.584+0000 7ff99aac4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-29T17:01:32.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:31.676+0000 7ff99aac4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-29T17:01:32.016 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:31.850+0000 7ff99aac4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-29T17:01:32.372 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:32.108+0000 7ff99aac4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-29T17:01:32.373 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:32.237+0000 7ff99aac4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-29T17:01:32.627 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:32.369+0000 7ff99aac4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:01:32.628 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:32.540+0000 7ff99aac4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-29T17:01:33.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:32.624+0000 7ff99aac4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-29T17:01:33.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:32.639055+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2022-11-29T17:01:33.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:32.641737+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00278265s) 2022-11-29T17:01:33.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.642634+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-11-29T17:01:33.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.642765+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-11-29T17:01:33.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.642869+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-11-29T17:01:33.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.642975+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:01:33.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.643427+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-11-29T17:01:33.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:32.656672+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2022-11-29T17:01:33.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.664265+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' 2022-11-29T17:01:33.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.668706+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:01:33.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.669883+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:01:33.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.675118+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' 2022-11-29T17:01:33.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:32.677081+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.182:0/4213572291' entity='mgr.y' 2022-11-29T17:01:34.180 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:34.181 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:01:34.181 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsid": "63fec4cc-7007-11ed-843b-001a4aab830c", 2022-11-29T17:01:34.181 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "health": { 2022-11-29T17:01:34.182 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-11-29T17:01:34.182 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "checks": {}, 2022-11-29T17:01:34.182 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mutes": [] 2022-11-29T17:01:34.183 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.183 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-11-29T17:01:34.183 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum": [ 2022-11-29T17:01:34.184 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 0 2022-11-29T17:01:34.184 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:34.184 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_names": [ 2022-11-29T17:01:34.185 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "a" 2022-11-29T17:01:34.185 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:34.185 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "quorum_age": 8, 2022-11-29T17:01:34.186 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "monmap": { 2022-11-29T17:01:34.186 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:34.186 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-11-29T17:01:34.186 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_mons": 1 2022-11-29T17:01:34.187 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.187 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osdmap": { 2022-11-29T17:01:34.187 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:34.188 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_osds": 0, 2022-11-29T17:01:34.192 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-11-29T17:01:34.192 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-11-29T17:01:34.193 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-11-29T17:01:34.193 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-11-29T17:01:34.193 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-11-29T17:01:34.193 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.194 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgmap": { 2022-11-29T17:01:34.194 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-11-29T17:01:34.194 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-11-29T17:01:34.194 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_pools": 0, 2022-11-29T17:01:34.194 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_objects": 0, 2022-11-29T17:01:34.195 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-11-29T17:01:34.195 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-11-29T17:01:34.195 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-11-29T17:01:34.195 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "bytes_total": 0 2022-11-29T17:01:34.196 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.196 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "fsmap": { 2022-11-29T17:01:34.196 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:34.196 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "by_rank": [], 2022-11-29T17:01:34.196 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "up:standby": 0 2022-11-29T17:01:34.197 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.197 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mgrmap": { 2022-11-29T17:01:34.197 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "available": true, 2022-11-29T17:01:34.198 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-11-29T17:01:34.198 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modules": [ 2022-11-29T17:01:34.198 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "iostat", 2022-11-29T17:01:34.199 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "nfs", 2022-11-29T17:01:34.199 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "restful" 2022-11-29T17:01:34.199 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ], 2022-11-29T17:01:34.200 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:34.200 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.201 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "servicemap": { 2022-11-29T17:01:34.201 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 1, 2022-11-29T17:01:34.201 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "modified": "2022-11-29T17:01:20.640111+0000", 2022-11-29T17:01:34.202 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "services": {} 2022-11-29T17:01:34.202 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: }, 2022-11-29T17:01:34.203 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "progress_events": {} 2022-11-29T17:01:34.203 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:01:34.660 INFO:teuthology.orchestra.run.smithi182.stderr:mgr is available 2022-11-29T17:01:34.871 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:33.644489+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.00553s) 2022-11-29T17:01:34.872 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:34.176654+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.182:0/215422466' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-11-29T17:01:35.916 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:35.916 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [global] 2022-11-29T17:01:35.916 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: fsid = 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:35.916 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2022-11-29T17:01:35.917 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2022-11-29T17:01:35.917 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2022-11-29T17:01:35.917 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2022-11-29T17:01:35.917 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:35.918 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [mgr] 2022-11-29T17:01:35.918 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2022-11-29T17:01:35.918 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 2022-11-29T17:01:35.918 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: [osd] 2022-11-29T17:01:35.918 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2022-11-29T17:01:35.919 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2022-11-29T17:01:35.940 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:34.645118+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 2s) 2022-11-29T17:01:37.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:35.912594+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.182:0/4009534039' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-11-29T17:01:38.512 INFO:teuthology.orchestra.run.smithi182.stderr:Enabling cephadm module... 2022-11-29T17:01:41.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:41.132083+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.182:0/2889759851' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2022-11-29T17:01:41.516 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: ignoring --setuser ceph since I am not root 2022-11-29T17:01:41.516 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: ignoring --setgroup ceph since I am not root 2022-11-29T17:01:41.516 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:41.340+0000 7f8e29700680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-29T17:01:41.517 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:41.421+0000 7f8e29700680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-29T17:01:42.189 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:41.788+0000 7f8e29700680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-29T17:01:42.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:41.189912+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.182:0/2889759851' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2022-11-29T17:01:42.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:41.189961+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 8s) 2022-11-29T17:01:42.829 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:42.530+0000 7f8e29700680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-29T17:01:42.829 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:42.613+0000 7f8e29700680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-29T17:01:43.265 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:42.826+0000 7f8e29700680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-29T17:01:44.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:43.760+0000 7f8e29700680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-29T17:01:44.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:43.888+0000 7f8e29700680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:01:44.016 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:43.966+0000 7f8e29700680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-29T17:01:44.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:44.056+0000 7f8e29700680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-29T17:01:44.516 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:44.253+0000 7f8e29700680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-29T17:01:44.855 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:44.533+0000 7f8e29700680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-29T17:01:44.856 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:44.632+0000 7f8e29700680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-29T17:01:45.717 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:45.364+0000 7f8e29700680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-29T17:01:45.717 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:45.447+0000 7f8e29700680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-29T17:01:45.718 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:45.538+0000 7f8e29700680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-29T17:01:46.255 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:45.715+0000 7f8e29700680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-29T17:01:46.256 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:45.979+0000 7f8e29700680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-29T17:01:46.256 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:46.110+0000 7f8e29700680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-29T17:01:46.256 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:46.252+0000 7f8e29700680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:01:46.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:46.430+0000 7f8e29700680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-29T17:01:47.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:01:46.515+0000 7f8e29700680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-29T17:01:47.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:01:47.172 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 6, 2022-11-29T17:01:47.173 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "available": false, 2022-11-29T17:01:47.173 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "active_name": "y", 2022-11-29T17:01:47.173 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_standby": 0 2022-11-29T17:01:47.173 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:01:48.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:46.529067+0000 mon.a (mon.0) 29 : cluster [INF] Active manager daemon y restarted 2022-11-29T17:01:48.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:46.529497+0000 mon.a (mon.0) 30 : cluster [INF] Activating manager daemon y 2022-11-29T17:01:48.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:46.533568+0000 mon.a (mon.0) 31 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2022-11-29T17:01:48.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:46.581723+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0523104s) 2022-11-29T17:01:48.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.582756+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:01:48.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.583409+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-11-29T17:01:48.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.584067+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-11-29T17:01:48.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.584285+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-11-29T17:01:48.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.584416+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-11-29T17:01:48.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:46.597977+0000 mon.a (mon.0) 38 : cluster [INF] Manager daemon y is now available 2022-11-29T17:01:48.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.609824+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:48.020 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.694904+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:48.020 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.695908+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:01:48.020 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.697214+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:01:48.021 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.699834+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:01:48.021 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.711303+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:01:48.021 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:46.712507+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:01:48.022 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:47.169740+0000 mon.a (mon.0) 46 : audit [DBG] from='client.? 172.21.15.182:0/2569067750' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-11-29T17:01:48.597 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for the mgr to restart... 2022-11-29T17:01:48.598 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mgr epoch 6... 2022-11-29T17:01:48.846 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:47.587062+0000 mon.a (mon.0) 47 : cluster [DBG] mgrmap e7: y(active, since 1.05764s) 2022-11-29T17:01:49.097 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:01:49.098 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mgrmap_epoch": 8, 2022-11-29T17:01:49.098 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "initialized": true 2022-11-29T17:01:49.098 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:01:49.537 INFO:teuthology.orchestra.run.smithi182.stderr:mgr epoch 6 is available 2022-11-29T17:01:49.538 INFO:teuthology.orchestra.run.smithi182.stderr:Setting orchestrator backend to cephadm... 2022-11-29T17:01:49.800 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:01:48.589396+0000 mon.a (mon.0) 48 : cluster [DBG] mgrmap e8: y(active, since 2s) 2022-11-29T17:01:49.801 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:49.089874+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-11-29T17:01:49.801 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:49.095524+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-11-29T17:01:51.206 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: value unchanged 2022-11-29T17:01:51.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:50.183124+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:51.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:50.187590+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:51.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:50.222395+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:01:51.605 INFO:teuthology.orchestra.run.smithi182.stderr:Generating ssh key... 2022-11-29T17:01:52.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:51.204444+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:53.008 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: Generating public/private rsa key pair. 2022-11-29T17:01:53.009 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: Your identification has been saved in /tmp/tmpxzj1n0bp/key. 2022-11-29T17:01:53.009 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: Your public key has been saved in /tmp/tmpxzj1n0bp/key.pub. 2022-11-29T17:01:53.010 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: The key fingerprint is: 2022-11-29T17:01:53.010 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: SHA256:2w0s2z1Ul7ypUQEYm2Iia0vsaIkqecX+mUGxzEckTTI ceph-63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:53.011 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: The key's randomart image is: 2022-11-29T17:01:53.011 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: +---[RSA 3072]----+ 2022-11-29T17:01:53.011 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | Eoo .o... | 2022-11-29T17:01:53.012 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | =. .o . o| 2022-11-29T17:01:53.012 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | ....o o .+.| 2022-11-29T17:01:53.013 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | .oo+o.. ...o| 2022-11-29T17:01:53.013 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | . == S o .. o | 2022-11-29T17:01:53.014 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | . O... * = o | 2022-11-29T17:01:53.014 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: | o * o. o o +. | 2022-11-29T17:01:53.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: |+ o . + . | 2022-11-29T17:01:53.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: |o. .+ | 2022-11-29T17:01:53.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: +----[SHA256]-----+ 2022-11-29T17:01:53.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:01:52.229387+0000 mgr.y (mgr.14116) 6 : cephadm [INF] Generating ssh key... 2022-11-29T17:01:53.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:52.532633+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:53.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:52.534425+0000 mon.a (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:53.654 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx6BfSZbs54Fx/7ARr4/utK2VFJcCqFrL55e1nGyQsJURH1r0p4DBODQCx40sak3C4raE2DFxUrJV8Dxq5K7ilhWxk5Q0EcBc7OI3sXq8WCxJhAlrIsc8SKp4VTpxVbc2gBiBV/nvtBAmoDKKctoQUYhZeVaO+obcyG1FiJ2DfQKRyHddfcghA5eh7YhjpPikP8p4v3WjyYwGs02LXmEyuUlzME9Yr7OR0CziGJDlPYNya4/YIag+DX6cfjpF/V1PZg/L+WLJvcJOttTaii7/35xc02GcZ+jXpwfmSBGLvFVfGitl/8TtHIJWqiY8sgFyAxmeGLgA3KwKhAy9XLoZ2Nh63ZFAiDHMfi/c5UdFuvK2kyV3TstBSf2rGkOW2BAFoLV6Up2R3wFJME2Z5HrvX4xh8hOhxuSgNkmvMj0zKuNVQvpQAh6d8pkIVpZ/rk44PiJ5qwDkm2UGLRtNcxYVVwYpvRgt5rxzMo7lt3B13N/TsnK2SFuwkOlWzfEXwEG0= ceph-63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:01:54.075 INFO:teuthology.orchestra.run.smithi182.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2022-11-29T17:01:54.075 INFO:teuthology.orchestra.run.smithi182.stderr:Adding key to root@localhost authorized_keys... 2022-11-29T17:01:54.076 INFO:teuthology.orchestra.run.smithi182.stderr:Adding host smithi182... 2022-11-29T17:01:54.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:53.652120+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:55.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:01:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: [80B blob data] 2022-11-29T17:01:55.409 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: Added host 'smithi182' with addr '172.21.15.182' 2022-11-29T17:01:55.911 INFO:teuthology.orchestra.run.smithi182.stderr:Deploying unmanaged mon service... 2022-11-29T17:01:56.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:54.700436+0000 mgr.y (mgr.14116) 8 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi182", "addr": "172.21.15.182", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:56.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:55.405861+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:56.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:55.446894+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:01:56.556 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: Scheduled mon update... 2022-11-29T17:01:57.249 INFO:teuthology.orchestra.run.smithi182.stderr:Deploying unmanaged mgr service... 2022-11-29T17:01:57.386 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:01:55.406144+0000 mgr.y (mgr.14116) 9 : cephadm [INF] Added host smithi182 2022-11-29T17:01:57.387 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:56.554722+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:58.275 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: Scheduled mgr update... 2022-11-29T17:01:58.510 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:56.550551+0000 mgr.y (mgr.14116) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:58.511 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:01:56.551685+0000 mgr.y (mgr.14116) 11 : cephadm [INF] Saving service mon spec with placement count:5 2022-11-29T17:01:58.511 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:57.917539+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:59.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:58.258765+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:01:59.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:58.270130+0000 mgr.y (mgr.14116) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:01:59.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:01:58.271435+0000 mgr.y (mgr.14116) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2022-11-29T17:01:59.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:01:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:58.273691+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:02:00.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:01:59.396739+0000 mon.a (mon.0) 59 : audit [INF] from='client.? 172.21.15.182:0/1906739944' entity='client.admin' 2022-11-29T17:02:00.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:00.313879+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.182:0/3960984292' entity='mgr.y' 2022-11-29T17:02:01.253 INFO:teuthology.orchestra.run.smithi182.stderr:Enabling the dashboard module... 2022-11-29T17:02:01.927 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:00.740347+0000 mon.a (mon.0) 61 : audit [INF] from='client.? 172.21.15.182:0/3682812237' entity='client.admin' 2022-11-29T17:02:02.997 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:02.246877+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.182:0/1764958831' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2022-11-29T17:02:02.998 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: ignoring --setuser ceph since I am not root 2022-11-29T17:02:02.998 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: ignoring --setgroup ceph since I am not root 2022-11-29T17:02:02.998 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:02.910+0000 7fb5c5d86680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-29T17:02:02.999 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:02.993+0000 7fb5c5d86680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-29T17:02:03.743 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:03.368+0000 7fb5c5d86680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-29T17:02:03.892 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:02:03.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "epoch": 9, 2022-11-29T17:02:03.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "available": true, 2022-11-29T17:02:03.893 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "active_name": "y", 2022-11-29T17:02:03.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "num_standby": 0 2022-11-29T17:02:03.894 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:02:04.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:02.743057+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.182:0/1764958831' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2022-11-29T17:02:04.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:02.743130+0000 mon.a (mon.0) 64 : cluster [DBG] mgrmap e9: y(active, since 16s) 2022-11-29T17:02:04.322 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:04.145+0000 7fb5c5d86680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-29T17:02:04.322 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:04.230+0000 7fb5c5d86680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-29T17:02:04.327 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for the mgr to restart... 2022-11-29T17:02:04.328 INFO:teuthology.orchestra.run.smithi182.stderr:Waiting for mgr epoch 9... 2022-11-29T17:02:04.580 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:04.451+0000 7fb5c5d86680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-29T17:02:05.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:03.889338+0000 mon.a (mon.0) 65 : audit [DBG] from='client.? 172.21.15.182:0/773169354' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-11-29T17:02:05.714 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:05.412+0000 7fb5c5d86680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-29T17:02:05.715 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:05.542+0000 7fb5c5d86680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:02:05.715 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:05.622+0000 7fb5c5d86680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-29T17:02:06.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:05.713+0000 7fb5c5d86680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-29T17:02:06.015 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:05.925+0000 7fb5c5d86680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-29T17:02:06.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:06.209+0000 7fb5c5d86680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-29T17:02:06.515 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:06.310+0000 7fb5c5d86680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-29T17:02:07.381 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.028+0000 7fb5c5d86680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-29T17:02:07.381 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.111+0000 7fb5c5d86680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-29T17:02:07.382 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.205+0000 7fb5c5d86680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-29T17:02:07.907 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.379+0000 7fb5c5d86680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-29T17:02:07.907 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.640+0000 7fb5c5d86680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-29T17:02:07.908 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.772+0000 7fb5c5d86680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-29T17:02:07.908 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:07.905+0000 7fb5c5d86680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:02:08.163 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:08.077+0000 7fb5c5d86680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-29T17:02:08.446 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:08.174107+0000 mon.a (mon.0) 66 : cluster [INF] Active manager daemon y restarted 2022-11-29T17:02:08.446 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:08.174512+0000 mon.a (mon.0) 67 : cluster [INF] Activating manager daemon y 2022-11-29T17:02:08.447 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:08.176115+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2022-11-29T17:02:08.447 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: debug 2022-11-29T17:02:08.161+0000 7fb5c5d86680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-29T17:02:08.448 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: [80B blob data] 2022-11-29T17:02:09.244 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: { 2022-11-29T17:02:09.245 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2022-11-29T17:02:09.245 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: "initialized": true 2022-11-29T17:02:09.246 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: } 2022-11-29T17:02:09.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:08.227111+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0526852s) 2022-11-29T17:02:09.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.228201+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:02:09.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.228805+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2022-11-29T17:02:09.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.229611+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-11-29T17:02:09.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.229782+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-11-29T17:02:09.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.229909+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-11-29T17:02:09.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:08.243773+0000 mon.a (mon.0) 75 : cluster [INF] Manager daemon y is now available 2022-11-29T17:02:09.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.337160+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:09.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.338403+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:09.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.362590+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:02:09.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:08.364175+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:02:09.671 INFO:teuthology.orchestra.run.smithi182.stderr:mgr epoch 9 is available 2022-11-29T17:02:09.672 INFO:teuthology.orchestra.run.smithi182.stderr:Generating a dashboard self-signed certificate... 2022-11-29T17:02:10.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:09.233712+0000 mgr.y (mgr.14146) 1 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-11-29T17:02:10.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:09.234288+0000 mon.a (mon.0) 80 : cluster [DBG] mgrmap e11: y(active, since 1.05986s) 2022-11-29T17:02:10.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:09.240243+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-11-29T17:02:10.678 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: Self-signed certificate created 2022-11-29T17:02:11.208 INFO:teuthology.orchestra.run.smithi182.stderr:Creating initial admin user... 2022-11-29T17:02:11.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:10.242736+0000 mon.a (mon.0) 81 : cluster [DBG] mgrmap e12: y(active, since 2s) 2022-11-29T17:02:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:10.261622+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:10.610066+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:02:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:10.674489+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:10.676273+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:12.322 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$.Otvu9bYdsVu/EOKuvsuXenPvJjH9MOTJKVksVpyuVL7jHet.m8ki", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1669741332, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2022-11-29T17:02:12.750 INFO:teuthology.orchestra.run.smithi182.stderr:Fetching dashboard port number... 2022-11-29T17:02:13.414 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: 8443 2022-11-29T17:02:13.601 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:12.101653+0000 mgr.y (mgr.14146) 4 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:02:13.601 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:12.320852+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:13.994 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: disabled 2022-11-29T17:02:14.001 INFO:teuthology.orchestra.run.smithi182.stderr:systemctl: inactive 2022-11-29T17:02:14.001 INFO:teuthology.orchestra.run.smithi182.stderr:firewalld.service is not enabled 2022-11-29T17:02:14.002 INFO:teuthology.orchestra.run.smithi182.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2022-11-29T17:02:14.003 INFO:teuthology.orchestra.run.smithi182.stderr:Ceph Dashboard is now available at: 2022-11-29T17:02:14.003 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:14.004 INFO:teuthology.orchestra.run.smithi182.stderr: URL: https://smithi182:8443/ 2022-11-29T17:02:14.004 INFO:teuthology.orchestra.run.smithi182.stderr: User: admin 2022-11-29T17:02:14.004 INFO:teuthology.orchestra.run.smithi182.stderr: Password: alm43cxscd 2022-11-29T17:02:14.004 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:14.005 INFO:teuthology.orchestra.run.smithi182.stderr:Enabling autotune for osd_memory_target 2022-11-29T17:02:14.519 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:14 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:13.412782+0000 mon.a (mon.0) 86 : audit [DBG] from='client.? 172.21.15.182:0/2863331570' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2022-11-29T17:02:15.380 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:14.328346+0000 mon.a (mon.0) 87 : cluster [DBG] mgrmap e13: y(active, since 6s) 2022-11-29T17:02:15.898 INFO:teuthology.orchestra.run.smithi182.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2022-11-29T17:02:16.373 INFO:teuthology.orchestra.run.smithi182.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2022-11-29T17:02:16.373 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.374 INFO:teuthology.orchestra.run.smithi182.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2022-11-29T17:02:16.374 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.374 INFO:teuthology.orchestra.run.smithi182.stderr:Or, if you are only running a single cluster on this host: 2022-11-29T17:02:16.374 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.375 INFO:teuthology.orchestra.run.smithi182.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2022-11-29T17:02:16.375 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.375 INFO:teuthology.orchestra.run.smithi182.stderr:Please consider enabling telemetry to help improve Ceph: 2022-11-29T17:02:16.375 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.376 INFO:teuthology.orchestra.run.smithi182.stderr: ceph telemetry on 2022-11-29T17:02:16.376 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.376 INFO:teuthology.orchestra.run.smithi182.stderr:For more information see: 2022-11-29T17:02:16.376 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.376 INFO:teuthology.orchestra.run.smithi182.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2022-11-29T17:02:16.377 INFO:teuthology.orchestra.run.smithi182.stderr: 2022-11-29T17:02:16.377 INFO:teuthology.orchestra.run.smithi182.stderr:Bootstrap complete. 2022-11-29T17:02:16.407 INFO:tasks.cephadm:Fetching config... 2022-11-29T17:02:16.408 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:02:16.409 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2022-11-29T17:02:16.428 INFO:tasks.cephadm:Fetching client.admin keyring... 2022-11-29T17:02:16.428 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:02:16.429 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2022-11-29T17:02:16.487 INFO:tasks.cephadm:Fetching mon keyring... 2022-11-29T17:02:16.488 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:02:16.488 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/var/lib/ceph/63fec4cc-7007-11ed-843b-001a4aab830c/mon.a/keyring of=/dev/stdout 2022-11-29T17:02:16.557 INFO:tasks.cephadm:Fetching pub ssh key... 2022-11-29T17:02:16.558 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:02:16.558 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2022-11-29T17:02:16.619 INFO:tasks.cephadm:Installing pub ssh key for root users... 2022-11-29T17:02:16.620 DEBUG:teuthology.orchestra.run.smithi182:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx6BfSZbs54Fx/7ARr4/utK2VFJcCqFrL55e1nGyQsJURH1r0p4DBODQCx40sak3C4raE2DFxUrJV8Dxq5K7ilhWxk5Q0EcBc7OI3sXq8WCxJhAlrIsc8SKp4VTpxVbc2gBiBV/nvtBAmoDKKctoQUYhZeVaO+obcyG1FiJ2DfQKRyHddfcghA5eh7YhjpPikP8p4v3WjyYwGs02LXmEyuUlzME9Yr7OR0CziGJDlPYNya4/YIag+DX6cfjpF/V1PZg/L+WLJvcJOttTaii7/35xc02GcZ+jXpwfmSBGLvFVfGitl/8TtHIJWqiY8sgFyAxmeGLgA3KwKhAy9XLoZ2Nh63ZFAiDHMfi/c5UdFuvK2kyV3TstBSf2rGkOW2BAFoLV6Up2R3wFJME2Z5HrvX4xh8hOhxuSgNkmvMj0zKuNVQvpQAh6d8pkIVpZ/rk44PiJ5qwDkm2UGLRtNcxYVVwYpvRgt5rxzMo7lt3B13N/TsnK2SFuwkOlWzfEXwEG0= ceph-63fec4cc-7007-11ed-843b-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-11-29T17:02:16.703 INFO:teuthology.orchestra.run.smithi182.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx6BfSZbs54Fx/7ARr4/utK2VFJcCqFrL55e1nGyQsJURH1r0p4DBODQCx40sak3C4raE2DFxUrJV8Dxq5K7ilhWxk5Q0EcBc7OI3sXq8WCxJhAlrIsc8SKp4VTpxVbc2gBiBV/nvtBAmoDKKctoQUYhZeVaO+obcyG1FiJ2DfQKRyHddfcghA5eh7YhjpPikP8p4v3WjyYwGs02LXmEyuUlzME9Yr7OR0CziGJDlPYNya4/YIag+DX6cfjpF/V1PZg/L+WLJvcJOttTaii7/35xc02GcZ+jXpwfmSBGLvFVfGitl/8TtHIJWqiY8sgFyAxmeGLgA3KwKhAy9XLoZ2Nh63ZFAiDHMfi/c5UdFuvK2kyV3TstBSf2rGkOW2BAFoLV6Up2R3wFJME2Z5HrvX4xh8hOhxuSgNkmvMj0zKuNVQvpQAh6d8pkIVpZ/rk44PiJ5qwDkm2UGLRtNcxYVVwYpvRgt5rxzMo7lt3B13N/TsnK2SFuwkOlWzfEXwEG0= ceph-63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:02:16.715 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx6BfSZbs54Fx/7ARr4/utK2VFJcCqFrL55e1nGyQsJURH1r0p4DBODQCx40sak3C4raE2DFxUrJV8Dxq5K7ilhWxk5Q0EcBc7OI3sXq8WCxJhAlrIsc8SKp4VTpxVbc2gBiBV/nvtBAmoDKKctoQUYhZeVaO+obcyG1FiJ2DfQKRyHddfcghA5eh7YhjpPikP8p4v3WjyYwGs02LXmEyuUlzME9Yr7OR0CziGJDlPYNya4/YIag+DX6cfjpF/V1PZg/L+WLJvcJOttTaii7/35xc02GcZ+jXpwfmSBGLvFVfGitl/8TtHIJWqiY8sgFyAxmeGLgA3KwKhAy9XLoZ2Nh63ZFAiDHMfi/c5UdFuvK2kyV3TstBSf2rGkOW2BAFoLV6Up2R3wFJME2Z5HrvX4xh8hOhxuSgNkmvMj0zKuNVQvpQAh6d8pkIVpZ/rk44PiJ5qwDkm2UGLRtNcxYVVwYpvRgt5rxzMo7lt3B13N/TsnK2SFuwkOlWzfEXwEG0= ceph-63fec4cc-7007-11ed-843b-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-11-29T17:02:16.756 INFO:teuthology.orchestra.run.smithi191.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCx6BfSZbs54Fx/7ARr4/utK2VFJcCqFrL55e1nGyQsJURH1r0p4DBODQCx40sak3C4raE2DFxUrJV8Dxq5K7ilhWxk5Q0EcBc7OI3sXq8WCxJhAlrIsc8SKp4VTpxVbc2gBiBV/nvtBAmoDKKctoQUYhZeVaO+obcyG1FiJ2DfQKRyHddfcghA5eh7YhjpPikP8p4v3WjyYwGs02LXmEyuUlzME9Yr7OR0CziGJDlPYNya4/YIag+DX6cfjpF/V1PZg/L+WLJvcJOttTaii7/35xc02GcZ+jXpwfmSBGLvFVfGitl/8TtHIJWqiY8sgFyAxmeGLgA3KwKhAy9XLoZ2Nh63ZFAiDHMfi/c5UdFuvK2kyV3TstBSf2rGkOW2BAFoLV6Up2R3wFJME2Z5HrvX4xh8hOhxuSgNkmvMj0zKuNVQvpQAh6d8pkIVpZ/rk44PiJ5qwDkm2UGLRtNcxYVVwYpvRgt5rxzMo7lt3B13N/TsnK2SFuwkOlWzfEXwEG0= ceph-63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:02:16.768 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2022-11-29T17:02:17.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:16 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:15.893798+0000 mon.a (mon.0) 88 : audit [INF] from='client.? 172.21.15.182:0/1612939689' entity='client.admin' 2022-11-29T17:02:19.723 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2022-11-29T17:02:19.724 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2022-11-29T17:02:20.328 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:19.064571+0000 mon.a (mon.0) 89 : audit [INF] from='client.? 172.21.15.182:0/257083646' entity='client.admin' 2022-11-29T17:02:21.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:20.305360+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:20.710303+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi182", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:02:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:20.713290+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:20.714488+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:20.719796+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:22.055 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi191 2022-11-29T17:02:22.056 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:02:22.056 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.conf 2022-11-29T17:02:22.076 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:02:22.077 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-11-29T17:02:22.136 INFO:tasks.cephadm:Adding host smithi191 to orchestrator... 2022-11-29T17:02:22.137 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch host add smithi191 2022-11-29T17:02:23.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.577678+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:23.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.585791+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:23.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.586775+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:23.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.587350+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:02:23.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:21.588412+0000 mgr.y (mgr.14146) 6 : cephadm [INF] Updating smithi182:/etc/ceph/ceph.conf 2022-11-29T17:02:23.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:21.605491+0000 mgr.y (mgr.14146) 7 : cephadm [INF] Updating smithi182:/etc/ceph/ceph.client.admin.keyring 2022-11-29T17:02:23.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.643551+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:23.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:21.646511+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:29.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:28.230805+0000 mgr.y (mgr.14146) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:31.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:30.231167+0000 mgr.y (mgr.14146) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:33.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:32.231555+0000 mgr.y (mgr.14146) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:35.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:34.231890+0000 mgr.y (mgr.14146) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:37.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:36.232151+0000 mgr.y (mgr.14146) 12 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:39.020 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: [90B blob data] 2022-11-29T17:02:39.335 INFO:teuthology.orchestra.run.smithi191.stdout:Added host 'smithi191' with addr '172.21.15.191' 2022-11-29T17:02:39.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch host ls --format=json 2022-11-29T17:02:39.765 INFO:journalctl@ceph.mgr.y.smithi182.stdout:Nov 29 17:02:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-y[101225]: [80B blob data] 2022-11-29T17:02:39.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:38.232453+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:39.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:38.617566+0000 mgr.y (mgr.14146) 14 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi191", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:02:40.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:39.332503+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:40.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:39.332873+0000 mgr.y (mgr.14146) 15 : cephadm [INF] Added host smithi191 2022-11-29T17:02:40.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:39.353640+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:40.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:39.354992+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:40.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:39.355910+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:02:40.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:39.906903+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:41.424 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:02:41.425 INFO:teuthology.orchestra.run.smithi191.stdout:[{"addr": "172.21.15.182", "hostname": "smithi182", "labels": [], "status": ""}, {"addr": "172.21.15.191", "hostname": "smithi191", "labels": [], "status": ""}] 2022-11-29T17:02:42.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:40.232888+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:42.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:40.676373+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:42.127 INFO:tasks.cephadm:Setting crush tunables to default 2022-11-29T17:02:42.128 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph osd crush tunables default 2022-11-29T17:02:43.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:41.421863+0000 mgr.y (mgr.14146) 17 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-11-29T17:02:44.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:42.233211+0000 mgr.y (mgr.14146) 18 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:44.693 INFO:teuthology.orchestra.run.smithi182.stderr:adjusted tunables profile to default 2022-11-29T17:02:45.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:43.903430+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.15.182:0/2131250605' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-11-29T17:02:45.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:43.966270+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:45.165 INFO:tasks.cephadm:Adding mon.a on smithi182 2022-11-29T17:02:45.166 INFO:tasks.cephadm:Adding mon.c on smithi182 2022-11-29T17:02:45.167 INFO:tasks.cephadm:Adding mon.b on smithi191 2022-11-29T17:02:45.167 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch apply mon '3;smithi182:172.21.15.182=a;smithi182:[v2:172.21.15.182:3301,v1:172.21.15.182:6790]=c;smithi191:172.21.15.191=b' 2022-11-29T17:02:46.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:44.233470+0000 mgr.y (mgr.14146) 19 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:46.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:44.689075+0000 mon.a (mon.0) 109 : audit [INF] from='client.? 172.21.15.182:0/2131250605' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-11-29T17:02:46.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:44.689122+0000 mon.a (mon.0) 110 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:02:46.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:44.703890+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:46.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:44.704702+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi191", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:02:46.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:44.708284+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:46.817 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mon update... 2022-11-29T17:02:47.307 DEBUG:teuthology.orchestra.run.smithi182:mon.c> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.c.service 2022-11-29T17:02:47.319 DEBUG:teuthology.orchestra.run.smithi191:mon.b> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mon.b.service 2022-11-29T17:02:47.328 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-11-29T17:02:47.328 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph mon dump -f json 2022-11-29T17:02:47.352 INFO:journalctl@ceph.mon.b.smithi191.stdout:-- Logs begin at Tue 2022-11-29 16:52:25 UTC. -- 2022-11-29T17:02:47.355 INFO:journalctl@ceph.mon.c.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:02:48.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:46.233798+0000 mgr.y (mgr.14146) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:48.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.814956+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:48.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.827708+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:02:48.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.829014+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:48.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.829774+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:02:48.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.919271+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:48.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.924608+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:48.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.926385+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:02:48.019 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.927196+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:49.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:46.807578+0000 mgr.y (mgr.14146) 21 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi182:172.21.15.182=a;smithi182:[v2:172.21.15.182:3301,v1:172.21.15.182:6790]=c;smithi191:172.21.15.191=b", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:02:49.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:46.809701+0000 mgr.y (mgr.14146) 22 : cephadm [INF] Saving service mon spec with placement smithi182:172.21.15.182=a;smithi182:[v2:172.21.15.182:3301,v1:172.21.15.182:6790]=c;smithi191:172.21.15.191=b;count:3 2022-11-29T17:02:49.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:46.830974+0000 mgr.y (mgr.14146) 23 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2022-11-29T17:02:49.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:46.858779+0000 mgr.y (mgr.14146) 24 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.client.admin.keyring 2022-11-29T17:02:49.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:46.927908+0000 mgr.y (mgr.14146) 25 : cephadm [INF] Deploying daemon mon.b on smithi191 2022-11-29T17:02:49.742 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:02:49.742 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":1,"fsid":"63fec4cc-7007-11ed-843b-001a4aab830c","modified":"2022-11-29T17:01:18.005066Z","created":"2022-11-29T17:01:18.005066Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3300","nonce":0},{"type":"v1","addr":"172.21.15.182:6789","nonce":0}]},"addr":"172.21.15.182:6789/0","public_addr":"172.21.15.182:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-11-29T17:02:49.743 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 1 2022-11-29T17:02:50.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:48.234420+0000 mgr.y (mgr.14146) 26 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:51.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:50 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:49.739258+0000 mon.a (mon.0) 122 : audit [DBG] from='client.? 172.21.15.191:0/553569949' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:02:51.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:50 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: debug 2022-11-29T17:02:50.947+0000 7f1a4db4f700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2022-11-29T17:02:51.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:50 smithi191 systemd[1]: Started Ceph mon.b for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:02:51.243 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-11-29T17:02:51.244 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph mon dump -f json 2022-11-29T17:02:56.250 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:02:56.250 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":2,"fsid":"63fec4cc-7007-11ed-843b-001a4aab830c","modified":"2022-11-29T17:02:50.952654Z","created":"2022-11-29T17:01:18.005066Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3300","nonce":0},{"type":"v1","addr":"172.21.15.182:6789","nonce":0}]},"addr":"172.21.15.182:6789/0","public_addr":"172.21.15.182:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-11-29T17:02:56.252 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 2 2022-11-29T17:02:56.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:50.955322+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:02:56.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:50.955511+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:50.955618+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2022-11-29T17:02:56.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:51.952395+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:52.235079+0000 mgr.y (mgr.14146) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:56.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:52.952142+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:52.953266+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2022-11-29T17:02:56.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:53.952286+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:54.235323+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:56.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:54.952470+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:55.952460+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:55.983000+0000 mon.a (mon.0) 132 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2022-11-29T17:02:56.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:55.991458+0000 mon.a (mon.0) 133 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} 2022-11-29T17:02:56.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:56.003643+0000 mon.a (mon.0) 134 : cluster [DBG] fsmap 2022-11-29T17:02:56.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:56.003672+0000 mon.a (mon.0) 135 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:02:56.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:56.003869+0000 mon.a (mon.0) 136 : cluster [DBG] mgrmap e13: y(active, since 47s) 2022-11-29T17:02:56.334 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:56.006937+0000 mon.a (mon.0) 137 : cluster [INF] overall HEALTH_OK 2022-11-29T17:02:56.335 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:56.011071+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:56.335 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:56.015674+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:02:56.335 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:56.016404+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:56.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:50.955322+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:02:56.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:50.955511+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:50.955618+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2022-11-29T17:02:56.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:51.952395+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:52.235079+0000 mgr.y (mgr.14146) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:56.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:52.952142+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:52.953266+0000 mon.b (mon.1) 1 : cluster [INF] mon.b calling monitor election 2022-11-29T17:02:56.519 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:53.952286+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.519 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:54.235323+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:56.519 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:54.952470+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.520 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:55.952460+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:56.520 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:55.983000+0000 mon.a (mon.0) 132 : cluster [INF] mon.a is new leader, mons a,b in quorum (ranks 0,1) 2022-11-29T17:02:56.521 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:55.991458+0000 mon.a (mon.0) 133 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0]} 2022-11-29T17:02:56.521 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:56.003643+0000 mon.a (mon.0) 134 : cluster [DBG] fsmap 2022-11-29T17:02:56.521 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:56.003672+0000 mon.a (mon.0) 135 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:02:56.522 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:56.003869+0000 mon.a (mon.0) 136 : cluster [DBG] mgrmap e13: y(active, since 47s) 2022-11-29T17:02:56.522 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:56.006937+0000 mon.a (mon.0) 137 : cluster [INF] overall HEALTH_OK 2022-11-29T17:02:56.523 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:56.011071+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:02:56.523 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:56.015674+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:02:56.524 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:56.016404+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:02:57.199 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:02:56.017012+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Deploying daemon mon.c on smithi182 2022-11-29T17:02:57.199 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:56.235675+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:57.199 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:56.248005+0000 mon.a (mon.0) 141 : audit [DBG] from='client.? 172.21.15.191:0/3601506384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:02:57.199 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:02:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:56.952720+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:57.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:02:56.017012+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Deploying daemon mon.c on smithi182 2022-11-29T17:02:57.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:56.235675+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:57.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:56.248005+0000 mon.a (mon.0) 141 : audit [DBG] from='client.? 172.21.15.191:0/3601506384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:02:57.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:02:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:56.952720+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:57.683 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2022-11-29T17:02:57.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph mon dump -f json 2022-11-29T17:02:58.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:58 smithi182 systemd[1]: Starting Ceph mon.c for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:02:59.255 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:58 smithi182 podman[110374]: 2022-11-29T17:02:59.255 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.166+0000 7fa7ed638880 0 set uid:gid to 167:167 (ceph:ceph) 2022-11-29T17:02:59.256 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.166+0000 7fa7ed638880 0 ceph version 16.2.10-1291-g8dc57b56 (8dc57b5624d909c1714a82ba84ff24e49431ea76) pacific (stable), process ceph-mon, pid 7 2022-11-29T17:02:59.256 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.166+0000 7fa7ed638880 0 pidfile_write: ignore empty --pid-file 2022-11-29T17:02:59.256 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.170+0000 7fa7ed638880 0 load: jerasure load: lrc load: isa 2022-11-29T17:02:59.256 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: RocksDB version: 6.8.1 2022-11-29T17:02:59.256 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.257 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-11-29T17:02:59.257 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Compile date Nov 28 2022 2022-11-29T17:02:59.257 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: DB SUMMARY 2022-11-29T17:02:59.257 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.258 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: CURRENT file: CURRENT 2022-11-29T17:02:59.258 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.258 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: IDENTITY file: IDENTITY 2022-11-29T17:02:59.258 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.258 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2022-11-29T17:02:59.259 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.259 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2022-11-29T17:02:59.259 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.259 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 636 ; 2022-11-29T17:02:59.259 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.260 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.error_if_exists: 0 2022-11-29T17:02:59.260 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.create_if_missing: 0 2022-11-29T17:02:59.260 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.paranoid_checks: 1 2022-11-29T17:02:59.260 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.env: 0x555eca309000 2022-11-29T17:02:59.261 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.fs: Posix File System 2022-11-29T17:02:59.261 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.info_log: 0x555ecb8b98a0 2022-11-29T17:02:59.261 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_file_opening_threads: 16 2022-11-29T17:02:59.261 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.statistics: (nil) 2022-11-29T17:02:59.261 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.use_fsync: 0 2022-11-29T17:02:59.262 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_log_file_size: 0 2022-11-29T17:02:59.262 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-11-29T17:02:59.262 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.log_file_time_to_roll: 0 2022-11-29T17:02:59.262 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.keep_log_file_num: 1000 2022-11-29T17:02:59.262 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.recycle_log_file_num: 0 2022-11-29T17:02:59.263 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.allow_fallocate: 1 2022-11-29T17:02:59.263 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.allow_mmap_reads: 0 2022-11-29T17:02:59.263 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.allow_mmap_writes: 0 2022-11-29T17:02:59.263 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.use_direct_reads: 0 2022-11-29T17:02:59.263 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-11-29T17:02:59.264 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.create_missing_column_families: 0 2022-11-29T17:02:59.264 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.db_log_dir: 2022-11-29T17:02:59.264 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2022-11-29T17:02:59.264 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.table_cache_numshardbits: 6 2022-11-29T17:02:59.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_subcompactions: 1 2022-11-29T17:02:59.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_background_flushes: -1 2022-11-29T17:02:59.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-11-29T17:02:59.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-11-29T17:02:59.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-11-29T17:02:59.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-11-29T17:02:59.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-11-29T17:02:59.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.advise_random_on_open: 1 2022-11-29T17:02:59.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.db_write_buffer_size: 0 2022-11-29T17:02:59.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.write_buffer_manager: 0x555ecc5b40f0 2022-11-29T17:02:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-11-29T17:02:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-11-29T17:02:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-11-29T17:02:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.use_adaptive_mutex: 0 2022-11-29T17:02:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.rate_limiter: (nil) 2022-11-29T17:02:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-11-29T17:02:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.wal_recovery_mode: 2 2022-11-29T17:02:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.enable_thread_tracking: 0 2022-11-29T17:02:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.enable_pipelined_write: 0 2022-11-29T17:02:59.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.unordered_write: 0 2022-11-29T17:02:59.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-11-29T17:02:59.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-11-29T17:02:59.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-11-29T17:02:59.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-11-29T17:02:59.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.row_cache: None 2022-11-29T17:02:59.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.wal_filter: None 2022-11-29T17:02:59.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-11-29T17:02:59.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.allow_ingest_behind: 0 2022-11-29T17:02:59.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.preserve_deletes: 0 2022-11-29T17:02:59.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.two_write_queues: 0 2022-11-29T17:02:59.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.manual_wal_flush: 0 2022-11-29T17:02:59.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.atomic_flush: 0 2022-11-29T17:02:59.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-11-29T17:02:59.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.persist_stats_to_disk: 0 2022-11-29T17:02:59.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-11-29T17:02:59.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.log_readahead_size: 0 2022-11-29T17:02:59.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-11-29T17:02:59.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_background_jobs: 2 2022-11-29T17:02:59.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_background_compactions: -1 2022-11-29T17:02:59.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-11-29T17:02:59.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-11-29T17:02:59.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.delayed_write_rate : 16777216 2022-11-29T17:02:59.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_total_wal_size: 0 2022-11-29T17:02:59.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-11-29T17:02:59.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.stats_dump_period_sec: 600 2022-11-29T17:02:59.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.stats_persist_period_sec: 600 2022-11-29T17:02:59.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-11-29T17:02:59.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_open_files: -1 2022-11-29T17:02:59.275 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bytes_per_sync: 0 2022-11-29T17:02:59.275 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-11-29T17:02:59.275 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-11-29T17:02:59.275 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_readahead_size: 0 2022-11-29T17:02:59.276 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Compression algorithms supported: 2022-11-29T17:02:59.276 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-11-29T17:02:59.276 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kZSTD supported: 0 2022-11-29T17:02:59.276 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kXpressCompression supported: 0 2022-11-29T17:02:59.276 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kLZ4HCCompression supported: 1 2022-11-29T17:02:59.277 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kLZ4Compression supported: 1 2022-11-29T17:02:59.277 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kBZip2Compression supported: 0 2022-11-29T17:02:59.277 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kZlibCompression supported: 1 2022-11-29T17:02:59.277 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: kSnappyCompression supported: 1 2022-11-29T17:02:59.277 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-11-29T17:02:59.278 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2022-11-29T17:02:59.278 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.278 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-11-29T17:02:59.278 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.278 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-11-29T17:02:59.279 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.merge_operator: 2022-11-29T17:02:59.279 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_filter: None 2022-11-29T17:02:59.279 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_filter_factory: None 2022-11-29T17:02:59.279 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-11-29T17:02:59.280 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.table_factory: BlockBasedTable 2022-11-29T17:02:59.280 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x555ecb863cf8) 2022-11-29T17:02:59.280 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cache_index_and_filter_blocks: 1 2022-11-29T17:02:59.280 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cache_index_and_filter_blocks_with_high_priority: 0 2022-11-29T17:02:59.280 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-11-29T17:02:59.281 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: pin_top_level_index_and_filter: 1 2022-11-29T17:02:59.281 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: index_type: 0 2022-11-29T17:02:59.281 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: data_block_index_type: 0 2022-11-29T17:02:59.281 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: index_shortening: 1 2022-11-29T17:02:59.281 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: data_block_hash_table_util_ratio: 0.750000 2022-11-29T17:02:59.282 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: hash_index_allow_collision: 1 2022-11-29T17:02:59.282 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: checksum: 1 2022-11-29T17:02:59.282 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: no_block_cache: 0 2022-11-29T17:02:59.282 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_cache: 0x555ecb89cf10 2022-11-29T17:02:59.282 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_cache_name: BinnedLRUCache 2022-11-29T17:02:59.283 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_cache_options: 2022-11-29T17:02:59.283 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: capacity : 536870912 2022-11-29T17:02:59.283 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: num_shard_bits : 4 2022-11-29T17:02:59.283 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: strict_capacity_limit : 0 2022-11-29T17:02:59.284 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: high_pri_pool_ratio: 0.000 2022-11-29T17:02:59.284 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_cache_compressed: (nil) 2022-11-29T17:02:59.284 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: persistent_cache: (nil) 2022-11-29T17:02:59.284 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_size: 4096 2022-11-29T17:02:59.284 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_size_deviation: 10 2022-11-29T17:02:59.285 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_restart_interval: 16 2022-11-29T17:02:59.285 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: index_block_restart_interval: 1 2022-11-29T17:02:59.285 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: metadata_block_size: 4096 2022-11-29T17:02:59.285 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: partition_filters: 0 2022-11-29T17:02:59.285 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: use_delta_encoding: 1 2022-11-29T17:02:59.287 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: filter_policy: rocksdb.BuiltinBloomFilter 2022-11-29T17:02:59.287 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: whole_key_filtering: 1 2022-11-29T17:02:59.288 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: verify_compression: 0 2022-11-29T17:02:59.288 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: read_amp_bytes_per_bit: 0 2022-11-29T17:02:59.288 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: format_version: 2 2022-11-29T17:02:59.288 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: enable_index_compression: 1 2022-11-29T17:02:59.288 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: block_align: 0 2022-11-29T17:02:59.289 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.289 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.write_buffer_size: 33554432 2022-11-29T17:02:59.289 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_write_buffer_number: 2 2022-11-29T17:02:59.289 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression: NoCompression 2022-11-29T17:02:59.290 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression: Disabled 2022-11-29T17:02:59.290 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.prefix_extractor: nullptr 2022-11-29T17:02:59.290 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-11-29T17:02:59.290 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.num_levels: 7 2022-11-29T17:02:59.290 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-11-29T17:02:59.291 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-11-29T17:02:59.291 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-11-29T17:02:59.291 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-11-29T17:02:59.291 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-11-29T17:02:59.291 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-11-29T17:02:59.292 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-11-29T17:02:59.292 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:02:59.292 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-11-29T17:02:59.292 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.window_bits: -14 2022-11-29T17:02:59.293 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.level: 32767 2022-11-29T17:02:59.293 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.strategy: 0 2022-11-29T17:02:59.293 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-11-29T17:02:59.293 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-11-29T17:02:59.293 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compression_opts.enabled: false 2022-11-29T17:02:59.294 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-11-29T17:02:59.294 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-11-29T17:02:59.294 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-11-29T17:02:59.294 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.target_file_size_base: 67108864 2022-11-29T17:02:59.294 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.target_file_size_multiplier: 1 2022-11-29T17:02:59.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-11-29T17:02:59.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-11-29T17:02:59.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-11-29T17:02:59.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-11-29T17:02:59.295 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-11-29T17:02:59.296 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-11-29T17:02:59.296 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-11-29T17:02:59.296 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-11-29T17:02:59.296 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-11-29T17:02:59.296 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-11-29T17:02:59.297 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-11-29T17:02:59.297 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-11-29T17:02:59.297 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.arena_block_size: 4194304 2022-11-29T17:02:59.297 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-11-29T17:02:59.298 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-11-29T17:02:59.298 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-11-29T17:02:59.298 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.disable_auto_compactions: 0 2022-11-29T17:02:59.298 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-11-29T17:02:59.298 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-11-29T17:02:59.299 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-11-29T17:02:59.299 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-11-29T17:02:59.299 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-11-29T17:02:59.299 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-11-29T17:02:59.299 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-11-29T17:02:59.300 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-11-29T17:02:59.300 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-11-29T17:02:59.300 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-11-29T17:02:59.300 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.table_properties_collectors: 2022-11-29T17:02:59.301 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.inplace_update_support: 0 2022-11-29T17:02:59.301 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-11-29T17:02:59.301 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-11-29T17:02:59.301 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-11-29T17:02:59.301 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.memtable_huge_page_size: 0 2022-11-29T17:02:59.302 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.bloom_locality: 0 2022-11-29T17:02:59.302 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.max_successive_merges: 0 2022-11-29T17:02:59.302 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-11-29T17:02:59.302 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.paranoid_file_checks: 0 2022-11-29T17:02:59.302 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.force_consistency_checks: 0 2022-11-29T17:02:59.303 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.report_bg_io_stats: 0 2022-11-29T17:02:59.303 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.ttl: 2592000 2022-11-29T17:02:59.303 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.171+0000 7fa7ed638880 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-11-29T17:02:59.303 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-11-29T17:02:59.303 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.304 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-11-29T17:02:59.304 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.304 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741379173439, "job": 1, "event": "recovery_started", "log_files": [3]} 2022-11-29T17:02:59.304 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2022-11-29T17:02:59.304 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-11-29T17:02:59.305 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741379173876, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1669741379, "oldest_key_time": 3, "file_creation_time": 0}} 2022-11-29T17:02:59.305 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.172+0000 7fa7ed638880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2022-11-29T17:02:59.305 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.305 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.173+0000 7fa7ed638880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1669741379174245, "job": 1, "event": "recovery_finished"} 2022-11-29T17:02:59.306 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.173+0000 7fa7ed638880 4 rocksdb: DB pointer 0x555ecb967800 2022-11-29T17:02:59.306 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.173+0000 7fa7d444a700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-11-29T17:02:59.306 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.173+0000 7fa7d444a700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-11-29T17:02:59.306 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** DB Stats ** 2022-11-29T17:02:59.306 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:02:59.307 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-11-29T17:02:59.307 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-11-29T17:02:59.307 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:02:59.307 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-11-29T17:02:59.307 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-11-29T17:02:59.308 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-11-29T17:02:59.308 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.308 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** Compaction Stats [default] ** 2022-11-29T17:02:59.308 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:02:59.308 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:02:59.309 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.309 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.309 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.309 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.310 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** Compaction Stats [default] ** 2022-11-29T17:02:59.310 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:02:59.310 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:02:59.310 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.310 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:02:59.311 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:02:59.311 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 bash[110374]: 3b30ca3505c95afe766c49afcdb88a1b6782f95901946e3cdddb401d70b705b4 2022-11-29T17:02:59.311 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:02:59.311 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:02:59.311 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:02:59.312 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:02:59.312 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Cumulative compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:02:59.312 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Interval compaction: 0.00 GB write, 0.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:02:59.312 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:02:59.312 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.313 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:02:59.313 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.313 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** Compaction Stats [default] ** 2022-11-29T17:02:59.313 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:02:59.313 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:02:59.314 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.314 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.314 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-11-29T17:02:59.314 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.315 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** Compaction Stats [default] ** 2022-11-29T17:02:59.315 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-11-29T17:02:59.315 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-11-29T17:02:59.315 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2022-11-29T17:02:59.315 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Uptime(secs): 0.0 total, 0.0 interval 2022-11-29T17:02:59.316 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Flush(GB): cumulative 0.000, interval 0.000 2022-11-29T17:02:59.316 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(GB): cumulative 0.000, interval 0.000 2022-11-29T17:02:59.316 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(Total Files): cumulative 0, interval 0 2022-11-29T17:02:59.316 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(L0 Files): cumulative 0, interval 0 2022-11-29T17:02:59.316 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: AddFile(Keys): cumulative 0, interval 0 2022-11-29T17:02:59.317 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Cumulative compaction: 0.00 GB write, 0.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:02:59.317 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-11-29T17:02:59.317 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-11-29T17:02:59.317 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.318 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: ** File Read Latency Histogram By Level [default] ** 2022-11-29T17:02:59.318 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.318 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.173+0000 7fa7ed638880 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2022-11-29T17:02:59.318 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.174+0000 7fa7ed638880 0 using public_addrv [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] 2022-11-29T17:02:59.318 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.174+0000 7fa7ed638880 0 starting mon.c rank -1 at public addrs [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] at bind addrs [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:02:59.319 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.175+0000 7fa7ed638880 1 mon.c@-1(???) e0 preinit fsid 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:02:59.319 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.190+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).mds e1 new map 2022-11-29T17:02:59.319 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.190+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).mds e1 print_map 2022-11-29T17:02:59.319 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: e1 2022-11-29T17:02:59.319 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: enable_multiple, ever_enabled_multiple: 1,1 2022-11-29T17:02:59.320 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-11-29T17:02:59.320 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: legacy client fscid: -1 2022-11-29T17:02:59.320 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.320 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: No filesystems configured 2022-11-29T17:02:59.320 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: 2022-11-29T17:02:59.321 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-11-29T17:02:59.321 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-11-29T17:02:59.321 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-11-29T17:02:59.322 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-11-29T17:02:59.322 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-11-29T17:02:59.322 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-11-29T17:02:59.322 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2022-11-29T17:02:59.323 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:02:59.323 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:02:59.323 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2022-11-29T17:02:59.323 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:02:56.017012+0000 mgr.y (mgr.14146) 30 : cephadm [INF] Deploying daemon mon.c on smithi182 2022-11-29T17:02:59.324 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:02:56.235675+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:02:59.324 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:56.248005+0000 mon.a (mon.0) 141 : audit [DBG] from='client.? 172.21.15.191:0/3601506384' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:02:59.324 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:56.952720+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:02:59.324 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: debug 2022-11-29T17:02:59.191+0000 7fa7d6c4f700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2022-11-29T17:02:59.325 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:02:59 smithi182 systemd[1]: Started Ceph mon.c for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:03:04.233 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-11-29T17:03:04.233 INFO:teuthology.orchestra.run.smithi191.stdout:{"epoch":3,"fsid":"63fec4cc-7007-11ed-843b-001a4aab830c","modified":"2022-11-29T17:02:59.196456Z","created":"2022-11-29T17:01:18.005066Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3300","nonce":0},{"type":"v1","addr":"172.21.15.182:6789","nonce":0}]},"addr":"172.21.15.182:6789/0","public_addr":"172.21.15.182:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.191:3300","nonce":0},{"type":"v1","addr":"172.21.15.191:6789","nonce":0}]},"addr":"172.21.15.191:6789/0","public_addr":"172.21.15.191:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.182:3301","nonce":0},{"type":"v1","addr":"172.21.15.182:6790","nonce":0}]},"addr":"172.21.15.182:6790/0","public_addr":"172.21.15.182:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2022-11-29T17:03:04.236 INFO:teuthology.orchestra.run.smithi191.stderr:dumped monmap epoch 3 2022-11-29T17:03:04.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:59.199341+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:03:04.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:59.199494+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2022-11-29T17:03:04.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:59.200450+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:03:04.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:59.200584+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:02:59.201885+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2022-11-29T17:03:04.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:02:59.397766+0000 mon.a (mon.0) 148 : audit [DBG] from='client.? 172.21.15.191:0/1964274895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:00.196089+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:00.236286+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:01.196014+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:01.197413+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2022-11-29T17:03:04.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:02.196066+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:02.236582+0000 mgr.y (mgr.14146) 34 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:03.196254+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:04.196445+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.214582+0000 mon.a (mon.0) 154 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2022-11-29T17:03:04.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.217473+0000 mon.a (mon.0) 155 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0]} 2022-11-29T17:03:04.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.229767+0000 mon.a (mon.0) 156 : cluster [DBG] fsmap 2022-11-29T17:03:04.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.229813+0000 mon.a (mon.0) 157 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:03:04.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.230021+0000 mon.a (mon.0) 158 : cluster [DBG] mgrmap e13: y(active, since 56s) 2022-11-29T17:03:04.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.233486+0000 mon.a (mon.0) 159 : cluster [INF] overall HEALTH_OK 2022-11-29T17:03:04.585 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:04.236042+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:04.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:04.237533+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:04.238592+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:04.586 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:04.239284+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:04.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:59.199341+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:03:04.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:59.199494+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2022-11-29T17:03:04.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:59.200450+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:03:04.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:59.200584+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:02:59.201885+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2022-11-29T17:03:04.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:02:59.397766+0000 mon.a (mon.0) 148 : audit [DBG] from='client.? 172.21.15.191:0/1964274895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:00.196089+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:00.236286+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:01.196014+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:01.197413+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2022-11-29T17:03:04.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:02.196066+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:02.236582+0000 mgr.y (mgr.14146) 34 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:03.196254+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:04.196445+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.214582+0000 mon.a (mon.0) 154 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2022-11-29T17:03:04.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.217473+0000 mon.a (mon.0) 155 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0]} 2022-11-29T17:03:04.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.229767+0000 mon.a (mon.0) 156 : cluster [DBG] fsmap 2022-11-29T17:03:04.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.229813+0000 mon.a (mon.0) 157 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:03:04.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.230021+0000 mon.a (mon.0) 158 : cluster [DBG] mgrmap e13: y(active, since 56s) 2022-11-29T17:03:04.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.233486+0000 mon.a (mon.0) 159 : cluster [INF] overall HEALTH_OK 2022-11-29T17:03:04.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:04.236042+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:04.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:04.237533+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:04.238592+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:04.774 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:04.239284+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:04.774 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:59.199341+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2022-11-29T17:03:04.775 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:02:59.199494+0000 mon.a (mon.0) 145 : cluster [INF] mon.a calling monitor election 2022-11-29T17:03:04.775 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:59.200450+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2022-11-29T17:03:04.775 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:59.200584+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.776 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:02:59.201885+0000 mon.b (mon.1) 2 : cluster [INF] mon.b calling monitor election 2022-11-29T17:03:04.776 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:02:59.397766+0000 mon.a (mon.0) 148 : audit [DBG] from='client.? 172.21.15.191:0/1964274895' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.776 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:00.196089+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.776 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:00.236286+0000 mgr.y (mgr.14146) 33 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.777 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:01.196014+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.777 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:01.197413+0000 mon.c (mon.2) 1 : cluster [INF] mon.c calling monitor election 2022-11-29T17:03:04.777 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:02.196066+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.777 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:02.236582+0000 mgr.y (mgr.14146) 34 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:04.777 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:03.196254+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.778 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:04.196445+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:04.778 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.214582+0000 mon.a (mon.0) 154 : cluster [INF] mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2022-11-29T17:03:04.778 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.217473+0000 mon.a (mon.0) 155 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0],b=[v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0],c=[v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0]} 2022-11-29T17:03:04.778 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.229767+0000 mon.a (mon.0) 156 : cluster [DBG] fsmap 2022-11-29T17:03:04.779 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.229813+0000 mon.a (mon.0) 157 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-11-29T17:03:04.779 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.230021+0000 mon.a (mon.0) 158 : cluster [DBG] mgrmap e13: y(active, since 56s) 2022-11-29T17:03:04.779 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.233486+0000 mon.a (mon.0) 159 : cluster [INF] overall HEALTH_OK 2022-11-29T17:03:04.779 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:04.236042+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:04.779 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:04.237533+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:04.780 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:04.238592+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:04.780 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:04.239284+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:05.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:04.236849+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:05.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:05.196479+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:05.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:04.236849+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:05.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:05.196479+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:05.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:04.236849+0000 mgr.y (mgr.14146) 35 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:05.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:05.196479+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2022-11-29T17:03:05.826 INFO:tasks.cephadm:Generating final ceph.conf file... 2022-11-29T17:03:05.826 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph config generate-minimal-conf 2022-11-29T17:03:06.969 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:05.822372+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:06.969 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:05.822816+0000 mgr.y (mgr.14146) 36 : cephadm [INF] Updating smithi182:/etc/ceph/ceph.conf 2022-11-29T17:03:06.969 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:05.855284+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:06.970 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:06.237123+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:06.970 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:05.822372+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:06.970 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:05.822816+0000 mgr.y (mgr.14146) 36 : cephadm [INF] Updating smithi182:/etc/ceph/ceph.conf 2022-11-29T17:03:06.971 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:05.855284+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:06.971 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:06.237123+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:07.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:05.822372+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:07.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:05.822816+0000 mgr.y (mgr.14146) 36 : cephadm [INF] Updating smithi182:/etc/ceph/ceph.conf 2022-11-29T17:03:07.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:05.855284+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:07.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:06.237123+0000 mgr.y (mgr.14146) 37 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:07.550 INFO:teuthology.orchestra.run.smithi182.stdout:# minimal ceph.conf for 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:03:07.551 INFO:teuthology.orchestra.run.smithi182.stdout:[global] 2022-11-29T17:03:07.551 INFO:teuthology.orchestra.run.smithi182.stdout: fsid = 63fec4cc-7007-11ed-843b-001a4aab830c 2022-11-29T17:03:07.551 INFO:teuthology.orchestra.run.smithi182.stdout: mon_host = [v2:172.21.15.182:3300/0,v1:172.21.15.182:6789/0] [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] [v2:172.21.15.182:3301/0,v1:172.21.15.182:6790/0] 2022-11-29T17:03:07.958 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2022-11-29T17:03:07.959 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:03:07.959 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/ceph/ceph.conf 2022-11-29T17:03:07.991 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:03:07.992 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-11-29T17:03:08.060 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:03:08.060 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.conf 2022-11-29T17:03:08.197 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:07.548403+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.182:0/3502632788' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:08.198 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:03:08.199 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-11-29T17:03:08.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:07.548403+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.182:0/3502632788' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:08.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:07.548403+0000 mon.c (mon.2) 2 : audit [DBG] from='client.? 172.21.15.182:0/3502632788' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:08.290 INFO:tasks.cephadm:Adding mgr.y on smithi182 2022-11-29T17:03:08.290 INFO:tasks.cephadm:Adding mgr.x on smithi191 2022-11-29T17:03:08.291 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch apply mgr '2;smithi182=y;smithi191=x' 2022-11-29T17:03:09.709 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:08.237360+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:09.709 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.352426+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.710 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:08.352907+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2022-11-29T17:03:09.710 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.363618+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:03:09.710 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.364903+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:03:09.710 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.369154+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.711 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.570933+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.711 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.576096+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.711 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:08.577077+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2022-11-29T17:03:09.711 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.577319+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:09.712 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.578014+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:09.712 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:08.578611+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:09.712 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:08.579162+0000 mgr.y (mgr.14146) 41 : cephadm [INF] Reconfiguring daemon mon.a on smithi182 2022-11-29T17:03:09.713 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:08.237360+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:09.713 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.352426+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.713 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:08.352907+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2022-11-29T17:03:09.714 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.363618+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:03:09.714 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.364903+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:03:09.714 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.369154+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.714 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.570933+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.715 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.576096+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.715 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:08.577077+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2022-11-29T17:03:09.715 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.577319+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:09.715 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.578014+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:09.716 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:08.578611+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:09.716 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:08.579162+0000 mgr.y (mgr.14146) 41 : cephadm [INF] Reconfiguring daemon mon.a on smithi182 2022-11-29T17:03:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:08.237360+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.352426+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:08.352907+0000 mgr.y (mgr.14146) 39 : cephadm [INF] Updating smithi191:/etc/ceph/ceph.conf 2022-11-29T17:03:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.363618+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:03:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.364903+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:03:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.369154+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.570933+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.576096+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:09.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:08.577077+0000 mgr.y (mgr.14146) 40 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2022-11-29T17:03:09.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.577319+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:09.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.578014+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:09.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:08.578611+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:09.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:08.579162+0000 mgr.y (mgr.14146) 41 : cephadm [INF] Reconfiguring daemon mon.a on smithi182 2022-11-29T17:03:11.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:09.758634+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:11.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:09.759195+0000 mgr.y (mgr.14146) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2022-11-29T17:03:11.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:09.759421+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:11.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:09.759920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:11.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:09.760389+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:11.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:09.760832+0000 mgr.y (mgr.14146) 43 : cephadm [INF] Reconfiguring daemon mon.c on smithi182 2022-11-29T17:03:11.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:09.758634+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:11.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:09.759195+0000 mgr.y (mgr.14146) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2022-11-29T17:03:11.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:09.759421+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:11.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:09.759920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:11.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:09.760389+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:11.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:09.760832+0000 mgr.y (mgr.14146) 43 : cephadm [INF] Reconfiguring daemon mon.c on smithi182 2022-11-29T17:03:11.050 INFO:teuthology.orchestra.run.smithi191.stdout:Scheduled mgr update... 2022-11-29T17:03:11.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:09.758634+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:11.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:09.759195+0000 mgr.y (mgr.14146) 42 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2022-11-29T17:03:11.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:09.759421+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:11.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:09.759920+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:11.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:09.760389+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:11.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:09.760832+0000 mgr.y (mgr.14146) 43 : cephadm [INF] Reconfiguring daemon mon.c on smithi182 2022-11-29T17:03:11.528 DEBUG:teuthology.orchestra.run.smithi191:mgr.x> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@mgr.x.service 2022-11-29T17:03:11.531 INFO:tasks.cephadm:Deploying OSDs... 2022-11-29T17:03:11.532 DEBUG:teuthology.orchestra.run.smithi182:> set -ex 2022-11-29T17:03:11.533 DEBUG:teuthology.orchestra.run.smithi182:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:03:11.554 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2022-11-29T17:03:11.555 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/nvme1n1 2022-11-29T17:03:11.560 INFO:journalctl@ceph.mgr.x.smithi191.stdout:-- Logs begin at Tue 2022-11-29 16:52:25 UTC. -- 2022-11-29T17:03:11.614 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/nvme1n1 2022-11-29T17:03:11.615 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:11.615 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 402058 Links: 1 Device type: 103,1 2022-11-29T17:03:11.615 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:11.615 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:11.616 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:02:18.847825198 +0000 2022-11-29T17:03:11.616 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:02:18.792826434 +0000 2022-11-29T17:03:11.616 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:02:18.792826434 +0000 2022-11-29T17:03:11.616 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:03:11.617 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2022-11-29T17:03:11.683 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:03:11.683 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:03:11.683 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000258981 s, 2.0 MB/s 2022-11-29T17:03:11.685 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2022-11-29T17:03:11.745 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/nvme2n1 2022-11-29T17:03:11.804 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/nvme2n1 2022-11-29T17:03:11.805 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:11.805 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 402154 Links: 1 Device type: 103,2 2022-11-29T17:03:11.805 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:11.805 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:11.806 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:02:18.859824928 +0000 2022-11-29T17:03:11.806 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:02:18.796826344 +0000 2022-11-29T17:03:11.806 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:02:18.796826344 +0000 2022-11-29T17:03:11.807 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:03:11.808 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2022-11-29T17:03:11.872 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:03:11.873 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:03:11.873 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000238019 s, 2.2 MB/s 2022-11-29T17:03:11.874 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2022-11-29T17:03:11.934 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/nvme3n1 2022-11-29T17:03:11.993 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/nvme3n1 2022-11-29T17:03:11.993 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:11.993 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 402260 Links: 1 Device type: 103,3 2022-11-29T17:03:11.994 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:11.994 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:11.995 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:02:18.870824681 +0000 2022-11-29T17:03:11.995 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:02:18.797826322 +0000 2022-11-29T17:03:11.995 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:02:18.797826322 +0000 2022-11-29T17:03:11.996 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:03:11.996 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2022-11-29T17:03:12.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:10.237818+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:12.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:10.934101+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:10.934788+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:12.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:10.935305+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:12.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:10.935805+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:12.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:11.048809+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:10.237818+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:12.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:10.934101+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:10.934788+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:12.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:10.935305+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:12.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:10.935805+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:12.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:11.048809+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.044 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:03:12.044 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:03:12.045 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000201584 s, 2.5 MB/s 2022-11-29T17:03:12.046 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2022-11-29T17:03:12.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:10.237818+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:10.934101+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:10.934788+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-11-29T17:03:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:10.935305+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-11-29T17:03:12.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:10.935805+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:12.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:11.048809+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.105 DEBUG:teuthology.orchestra.run.smithi182:> stat /dev/nvme4n1 2022-11-29T17:03:12.163 INFO:teuthology.orchestra.run.smithi182.stdout: File: /dev/nvme4n1 2022-11-29T17:03:12.164 INFO:teuthology.orchestra.run.smithi182.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:12.164 INFO:teuthology.orchestra.run.smithi182.stdout:Device: 6h/6d Inode: 402312 Links: 1 Device type: 103,4 2022-11-29T17:03:12.164 INFO:teuthology.orchestra.run.smithi182.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:12.164 INFO:teuthology.orchestra.run.smithi182.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:12.165 INFO:teuthology.orchestra.run.smithi182.stdout:Access: 2022-11-29 17:02:18.882824411 +0000 2022-11-29T17:03:12.165 INFO:teuthology.orchestra.run.smithi182.stdout:Modify: 2022-11-29 17:02:18.800826255 +0000 2022-11-29T17:03:12.165 INFO:teuthology.orchestra.run.smithi182.stdout:Change: 2022-11-29 17:02:18.800826255 +0000 2022-11-29T17:03:12.165 INFO:teuthology.orchestra.run.smithi182.stdout: Birth: - 2022-11-29T17:03:12.166 DEBUG:teuthology.orchestra.run.smithi182:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2022-11-29T17:03:12.229 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records in 2022-11-29T17:03:12.230 INFO:teuthology.orchestra.run.smithi182.stderr:1+0 records out 2022-11-29T17:03:12.230 INFO:teuthology.orchestra.run.smithi182.stderr:512 bytes copied, 0.000224469 s, 2.3 MB/s 2022-11-29T17:03:12.232 DEBUG:teuthology.orchestra.run.smithi182:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2022-11-29T17:03:12.293 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-11-29T17:03:12.293 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2022-11-29T17:03:12.314 DEBUG:teuthology.misc:devs=['/dev/nvme1n1', '/dev/nvme2n1', '/dev/nvme3n1', '/dev/nvme4n1'] 2022-11-29T17:03:12.315 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/nvme1n1 2022-11-29T17:03:12.374 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/nvme1n1 2022-11-29T17:03:12.375 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:12.375 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 406365 Links: 1 Device type: 103,1 2022-11-29T17:03:12.376 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:12.376 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:12.376 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:02:43.020771666 +0000 2022-11-29T17:03:12.377 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:02:42.958772787 +0000 2022-11-29T17:03:12.377 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:02:42.958772787 +0000 2022-11-29T17:03:12.377 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:03:12.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/nvme1n1 of=/dev/null count=1 2022-11-29T17:03:12.443 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:03:12.444 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:03:12.444 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000273555 s, 1.9 MB/s 2022-11-29T17:03:12.445 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/nvme1n1 2022-11-29T17:03:12.506 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/nvme2n1 2022-11-29T17:03:12.564 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/nvme2n1 2022-11-29T17:03:12.565 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:12.565 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 411547 Links: 1 Device type: 103,2 2022-11-29T17:03:12.565 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:12.565 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:12.566 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:02:43.031771467 +0000 2022-11-29T17:03:12.566 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:02:42.960772751 +0000 2022-11-29T17:03:12.566 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:02:42.960772751 +0000 2022-11-29T17:03:12.566 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:03:12.567 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/nvme2n1 of=/dev/null count=1 2022-11-29T17:03:12.633 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:03:12.633 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:03:12.634 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.00024496 s, 2.1 MB/s 2022-11-29T17:03:12.635 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/nvme2n1 2022-11-29T17:03:12.696 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/nvme3n1 2022-11-29T17:03:12.755 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/nvme3n1 2022-11-29T17:03:12.755 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:12.756 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 415749 Links: 1 Device type: 103,3 2022-11-29T17:03:12.756 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:12.756 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:12.757 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:02:43.041771286 +0000 2022-11-29T17:03:12.757 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:02:42.962772715 +0000 2022-11-29T17:03:12.757 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:02:42.962772715 +0000 2022-11-29T17:03:12.758 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:03:12.758 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/nvme3n1 of=/dev/null count=1 2022-11-29T17:03:12.821 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:03:12.822 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:03:12.822 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000222092 s, 2.3 MB/s 2022-11-29T17:03:12.823 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/nvme3n1 2022-11-29T17:03:12.882 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/nvme4n1 2022-11-29T17:03:12.900 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:10.934592+0000 mgr.y (mgr.14146) 45 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2022-11-29T17:03:12.900 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:10.936259+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Reconfiguring daemon mon.b on smithi191 2022-11-29T17:03:12.901 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:11.045093+0000 mgr.y (mgr.14146) 47 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi182=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:12.901 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:11.046107+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Saving service mgr spec with placement smithi182=y;smithi191=x;count:2 2022-11-29T17:03:12.901 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.276623+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.902 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.277467+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:12.902 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.278412+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:12.902 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.279021+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:12.902 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.283291+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:12.903 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.284565+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:12.903 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.287729+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-11-29T17:03:12.903 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.288473+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:12.903 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:12.289199+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:12.921 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/nvme4n1 2022-11-29T17:03:12.921 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 0 Blocks: 0 IO Block: 4096 block special file 2022-11-29T17:03:12.922 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 414129 Links: 1 Device type: 103,4 2022-11-29T17:03:12.922 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0660/brw-rw----) Uid: ( 0/ root) Gid: ( 6/ disk) 2022-11-29T17:03:12.922 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:nvme_device_t:s0 2022-11-29T17:03:12.922 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-11-29 17:02:43.052771087 +0000 2022-11-29T17:03:12.923 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-11-29 17:02:42.965772661 +0000 2022-11-29T17:03:12.923 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-11-29 17:02:42.965772661 +0000 2022-11-29T17:03:12.923 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-11-29T17:03:12.924 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/dev/nvme4n1 of=/dev/null count=1 2022-11-29T17:03:12.989 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-11-29T17:03:12.990 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-11-29T17:03:12.990 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000242478 s, 2.1 MB/s 2022-11-29T17:03:12.991 DEBUG:teuthology.orchestra.run.smithi191:> ! mount | grep -v devtmpfs | grep -q /dev/nvme4n1 2022-11-29T17:03:13.050 INFO:tasks.cephadm:Deploying osd.0 on smithi182 with /dev/nvme4n1... 2022-11-29T17:03:13.051 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1 2022-11-29T17:03:13.079 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:10.934592+0000 mgr.y (mgr.14146) 45 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2022-11-29T17:03:13.080 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:10.936259+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Reconfiguring daemon mon.b on smithi191 2022-11-29T17:03:13.080 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:11.045093+0000 mgr.y (mgr.14146) 47 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi182=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:13.081 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:11.046107+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Saving service mgr spec with placement smithi182=y;smithi191=x;count:2 2022-11-29T17:03:13.081 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.276623+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:13.082 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.277467+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:13.082 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.278412+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:13.082 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.279021+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:13.083 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.283291+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:13.083 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.284565+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:13.084 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.287729+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-11-29T17:03:13.084 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.288473+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:13.085 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:12.289199+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:13.086 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:10.934592+0000 mgr.y (mgr.14146) 45 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2022-11-29T17:03:13.086 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:10.936259+0000 mgr.y (mgr.14146) 46 : cephadm [INF] Reconfiguring daemon mon.b on smithi191 2022-11-29T17:03:13.087 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:11.045093+0000 mgr.y (mgr.14146) 47 : audit [DBG] from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi182=y;smithi191=x", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:13.087 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:11.046107+0000 mgr.y (mgr.14146) 48 : cephadm [INF] Saving service mgr spec with placement smithi182=y;smithi191=x;count:2 2022-11-29T17:03:13.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.276623+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:13.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.277467+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:13.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.278412+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:13.089 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.279021+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:13.089 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.283291+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:13.090 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.284565+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:13.090 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.287729+0000 mon.a (mon.0) 191 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-11-29T17:03:13.091 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.288473+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:13.091 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:12.289199+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:13.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:12.238153+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:13.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:12.289833+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Deploying daemon mgr.x on smithi191 2022-11-29T17:03:13.834 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:13 smithi191 systemd[1]: Starting Ceph mgr.x for 63fec4cc-7007-11ed-843b-001a4aab830c... 2022-11-29T17:03:13.940 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:12.238153+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:13.941 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:12.289833+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Deploying daemon mgr.x on smithi191 2022-11-29T17:03:13.941 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:12.238153+0000 mgr.y (mgr.14146) 49 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:13.942 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:12.289833+0000 mgr.y (mgr.14146) 50 : cephadm [INF] Deploying daemon mgr.x on smithi191 2022-11-29T17:03:14.706 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 podman[104750]: 2022-11-29T17:03:14.707 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:14.601+0000 7ff43cc09700 1 -- 172.21.15.191:0/1122613019 <== mon.1 v2:172.21.15.191:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x565454cb44e0 con 0x565454c8b400 2022-11-29T17:03:14.707 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 bash[104750]: 3f210feb5dd82ebdd9b77b0b5ea1f7ce552f0954ad2c50b9a84b8051bf054a69 2022-11-29T17:03:14.890 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping: /dev/nvme4n1 2022-11-29T17:03:14.891 INFO:teuthology.orchestra.run.smithi182.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:03:14.891 INFO:teuthology.orchestra.run.smithi182.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme4n1 bs=1M count=10 conv=fsync 2022-11-29T17:03:14.892 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10+0 records in 2022-11-29T17:03:14.892 INFO:teuthology.orchestra.run.smithi182.stderr:10+0 records out 2022-11-29T17:03:14.893 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0140988 s, 744 MB/s 2022-11-29T17:03:14.893 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping successful for: 2022-11-29T17:03:15.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 systemd[1]: Started Ceph mgr.x for 63fec4cc-7007-11ed-843b-001a4aab830c. 2022-11-29T17:03:15.081 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:14.729+0000 7ff44d1e4680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-29T17:03:15.081 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:14 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:14.826+0000 7ff44d1e4680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-29T17:03:15.367 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi182:/dev/nvme4n1 2022-11-29T17:03:15.580 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:15.209+0000 7ff44d1e4680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-29T17:03:16.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:16 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:16.004+0000 7ff44d1e4680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-29T17:03:16.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:14.238327+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:16.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:14.769700+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:16.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:14.771430+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:16.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:14.772476+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:16.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:14.773072+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:16.151 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:14.238327+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:16.151 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:14.769700+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:16.151 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:14.771430+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:16.152 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:14.772476+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:16.152 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:14.773072+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:16.152 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:14.238327+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:16.153 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:14.769700+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:16.153 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:14.771430+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:16.153 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:14.772476+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:16.154 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:14.773072+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:16.580 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:16 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:16.092+0000 7ff44d1e4680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-29T17:03:16.580 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:16 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:16.310+0000 7ff44d1e4680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-29T17:03:17.472 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:16.238507+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:17.473 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:16.238918+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.473 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:16.244734+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.473 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:16.246667+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2022-11-29T17:03:17.474 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:16.246954+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:17.474 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:16.247699+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:17.474 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:16.248270+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.475 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:16.248819+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi182 2022-11-29T17:03:17.475 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.177020+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:17.476 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.179140+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:17.476 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.179631+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.477 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:16.238507+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:17.478 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:16.238918+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.478 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:16.244734+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.478 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:16.246667+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2022-11-29T17:03:17.479 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:16.246954+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:17.479 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:16.247699+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:17.479 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:16.248270+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.480 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:16.248819+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi182 2022-11-29T17:03:17.480 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.177020+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:17.480 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.179140+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:17.480 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.179631+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.550 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:17.252+0000 7ff44d1e4680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-29T17:03:17.550 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:17.379+0000 7ff44d1e4680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:03:17.551 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:17.457+0000 7ff44d1e4680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-29T17:03:17.551 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:16.238507+0000 mgr.y (mgr.14146) 52 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:17.552 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:16.238918+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.552 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:16.244734+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:17.552 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:16.246667+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2022-11-29T17:03:17.553 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:16.246954+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-11-29T17:03:17.553 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:16.247699+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2022-11-29T17:03:17.554 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:16.248270+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.554 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:16.248819+0000 mgr.y (mgr.14146) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi182 2022-11-29T17:03:17.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.177020+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:17.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.179140+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:17.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.179631+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:17.830 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:17.547+0000 7ff44d1e4680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-29T17:03:17.830 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:17.742+0000 7ff44d1e4680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-29T17:03:18.330 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:18.023+0000 7ff44d1e4680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-29T17:03:18.331 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:18.120+0000 7ff44d1e4680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-29T17:03:18.948 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.174799+0000 mgr.y (mgr.14146) 55 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:18.948 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.770765+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:18.949 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.772825+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:18.949 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.773728+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:18.950 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.774248+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:18.950 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:17.778305+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:18.951 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:18.373006+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:18.951 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.174799+0000 mgr.y (mgr.14146) 55 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:18.952 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.770765+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:18.953 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.772825+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:18.953 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.773728+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:18.954 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.774248+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:18.955 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:17.778305+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:18.955 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:18 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:18.373006+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:19.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:18.841+0000 7ff44d1e4680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-29T17:03:19.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:18.921+0000 7ff44d1e4680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-29T17:03:19.080 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.013+0000 7ff44d1e4680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-29T17:03:19.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.174799+0000 mgr.y (mgr.14146) 55 : audit [DBG] from='client.14205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:19.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.770765+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:19.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.772825+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:19.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.773728+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:19.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.774248+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:19.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:17.778305+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:19.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:18 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:18.373006+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:19.447 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.186+0000 7ff44d1e4680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-29T17:03:19.711 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.445+0000 7ff44d1e4680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-29T17:03:19.712 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.576+0000 7ff44d1e4680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-29T17:03:19.966 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.709+0000 7ff44d1e4680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-29T17:03:19.967 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.880+0000 7ff44d1e4680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-29T17:03:19.968 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:18.238728+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:19.968 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.676031+0000 mon.a (mon.0) 212 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]: dispatch 2022-11-29T17:03:19.968 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.679188+0000 mon.a (mon.0) 213 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]': finished 2022-11-29T17:03:19.969 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:19.679248+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2022-11-29T17:03:19.969 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.679354+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:20.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:18.238728+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:20.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.676031+0000 mon.a (mon.0) 212 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]: dispatch 2022-11-29T17:03:20.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.679188+0000 mon.a (mon.0) 213 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]': finished 2022-11-29T17:03:20.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:19.679248+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2022-11-29T17:03:20.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.679354+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:20.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:18.238728+0000 mgr.y (mgr.14146) 56 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:20.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.676031+0000 mon.a (mon.0) 212 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]: dispatch 2022-11-29T17:03:20.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.679188+0000 mon.a (mon.0) 213 : audit [INF] from='client.? 172.21.15.182:0/4268051859' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "52dc6fca-50a0-4fe1-9b99-c9aa681b8646"}]': finished 2022-11-29T17:03:20.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:19.679248+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2022-11-29T17:03:20.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.679354+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:20.330 INFO:journalctl@ceph.mgr.x.smithi191.stdout:Nov 29 17:03:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mgr-x[104766]: debug 2022-11-29T17:03:19.964+0000 7ff44d1e4680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-29T17:03:21.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:20 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:19.978301+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2022-11-29T17:03:21.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:20 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.979371+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2022-11-29T17:03:21.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:20 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.979680+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-11-29T17:03:21.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:20 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.980656+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2022-11-29T17:03:21.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:20 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:19.980930+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-11-29T17:03:21.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:19.978301+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2022-11-29T17:03:21.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.979371+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2022-11-29T17:03:21.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.979680+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-11-29T17:03:21.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.980656+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2022-11-29T17:03:21.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:19.980930+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-11-29T17:03:21.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:19.978301+0000 mon.a (mon.0) 216 : cluster [DBG] Standby manager daemon x started 2022-11-29T17:03:21.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.979371+0000 mon.b (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2022-11-29T17:03:21.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.979680+0000 mon.b (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-11-29T17:03:21.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.980656+0000 mon.b (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2022-11-29T17:03:21.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:20 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:19.980930+0000 mon.b (mon.1) 6 : audit [DBG] from='mgr.? 172.21.15.191:0/785508163' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-11-29T17:03:22.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:20.238991+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:22.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:20.791561+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2022-11-29T17:03:22.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:20.791689+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-11-29T17:03:22.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:20.991530+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.182:0/1679874319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:22.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:20.238991+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:22.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:20.791561+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2022-11-29T17:03:22.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:20.791689+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-11-29T17:03:22.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:20.991530+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.182:0/1679874319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:22.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:20.238991+0000 mgr.y (mgr.14146) 57 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:22.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:20.791561+0000 mon.a (mon.0) 217 : cluster [DBG] mgrmap e14: y(active, since 72s), standbys: x 2022-11-29T17:03:22.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:20.791689+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2022-11-29T17:03:22.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:20.991530+0000 mon.c (mon.2) 3 : audit [DBG] from='client.? 172.21.15.182:0/1679874319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:24.023 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:22.239272+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:24.024 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:22.239272+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:24.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:23 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:22.239272+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:26.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:24.239499+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:26.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:24.239499+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:26.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:24.239499+0000 mgr.y (mgr.14146) 59 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:27.013 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:26.068520+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-11-29T17:03:27.013 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:26.069079+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:27.014 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:26.069522+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Deploying daemon osd.0 on smithi182 2022-11-29T17:03:27.014 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:26.239757+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:27.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:26.068520+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-11-29T17:03:27.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:26.069079+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:27.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:26.069522+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Deploying daemon osd.0 on smithi182 2022-11-29T17:03:27.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:26 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:26.239757+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:27.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:26 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:26.068520+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-11-29T17:03:27.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:26 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:26.069079+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:27.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:26 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:26.069522+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Deploying daemon osd.0 on smithi182 2022-11-29T17:03:27.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:26 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:26.239757+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:29.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:28.240000+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:29.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:28.240000+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:29.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:28.240000+0000 mgr.y (mgr.14146) 62 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:31.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:30.240254+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:31.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:30.240254+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:31.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:30.240254+0000 mgr.y (mgr.14146) 63 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:33.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:32.240479+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:33.631 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:32.240479+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:33.631 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:32.240479+0000 mgr.y (mgr.14146) 64 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:35.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:33.957832+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:35.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:33.977956+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:35.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:33.978959+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:35.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:33.979490+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:35.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:34.240716+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:35.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:33.957832+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:35.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:33.977956+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:35.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:33.978959+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:35.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:33.979490+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:35.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:34.240716+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:35.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:33.957832+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:35.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:33.977956+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:35.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:33.978959+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:35.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:33.979490+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:35.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:34.240716+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:37.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:36.240983+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:37.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:36.278974+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:36.683918+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:37.089444+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-11-29T17:03:37.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:36.240983+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:37.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:36.278974+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:36.683918+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:37.089444+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-11-29T17:03:37.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:36.240983+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:37.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:36.278974+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:36.683918+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:37.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:37.089444+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-11-29T17:03:39.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:37.687876+0000 mon.a (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-11-29T17:03:39.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:37.687922+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-11-29T17:03:39.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:37.688050+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:39.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:37.688422+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:03:39.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:37.687876+0000 mon.a (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-11-29T17:03:39.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:37.687922+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-11-29T17:03:39.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:37.688050+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:39.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:37.688422+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:03:39.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:37.687876+0000 mon.a (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-11-29T17:03:39.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:37.687922+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-11-29T17:03:39.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:37.688050+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:39.084 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:37.688422+0000 mon.a (mon.0) 231 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:03:39.837 INFO:teuthology.orchestra.run.smithi182.stdout:Created osd(s) 0 on host 'smithi182' 2022-11-29T17:03:40.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:38.241235+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:40.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:38.686342+0000 mon.a (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:03:40.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:38.686412+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-11-29T17:03:40.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:38.686840+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:38.690651+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:38.241235+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:40.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:38.686342+0000 mon.a (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:03:40.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:38.686412+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-11-29T17:03:40.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:38.686840+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:38.690651+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:38.241235+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:40.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:38.686342+0000 mon.a (mon.0) 232 : audit [INF] from='osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:03:40.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:38.686412+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-11-29T17:03:40.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:38.686840+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:38.690651+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.378 DEBUG:teuthology.orchestra.run.smithi182:osd.0> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.0.service 2022-11-29T17:03:40.382 INFO:tasks.cephadm:Deploying osd.1 on smithi182 with /dev/nvme3n1... 2022-11-29T17:03:40.383 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme3n1 2022-11-29T17:03:40.415 INFO:journalctl@ceph.osd.0.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:03:40.694 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:38.074938+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:03:40.695 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:38.075029+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:03:40.695 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.692099+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.696 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:39.695316+0000 mon.a (mon.0) 237 : cluster [INF] osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936] boot 2022-11-29T17:03:40.696 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:39.695349+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2022-11-29T17:03:40.696 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.695619+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:40.696 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.835535+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:40.697 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.854846+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:40.697 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.855864+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:40.697 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:39.856387+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:41.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:38.074938+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:03:41.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:38.075029+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:03:41.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.692099+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:41.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:39.695316+0000 mon.a (mon.0) 237 : cluster [INF] osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936] boot 2022-11-29T17:03:41.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:39.695349+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2022-11-29T17:03:41.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.695619+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:41.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.835535+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:41.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.854846+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:41.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.855864+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:41.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:40 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:39.856387+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:41.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:38.074938+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:03:41.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:38.075029+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:03:41.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.692099+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:41.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:39.695316+0000 mon.a (mon.0) 237 : cluster [INF] osd.0 [v2:172.21.15.182:6802/2748164936,v1:172.21.15.182:6803/2748164936] boot 2022-11-29T17:03:41.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:39.695349+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2022-11-29T17:03:41.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.695619+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-11-29T17:03:41.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.835535+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:41.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.854846+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:03:41.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.855864+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:41.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:40 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:39.856387+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:03:42.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:40.241441+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:42.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:40.836930+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-11-29T17:03:42.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:40.241441+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:42.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:40.836930+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-11-29T17:03:42.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:40.241441+0000 mgr.y (mgr.14146) 68 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-11-29T17:03:42.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:40.836930+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-11-29T17:03:42.760 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping: /dev/nvme3n1 2022-11-29T17:03:42.761 INFO:teuthology.orchestra.run.smithi182.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:03:42.761 INFO:teuthology.orchestra.run.smithi182.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme3n1 bs=1M count=10 conv=fsync 2022-11-29T17:03:42.761 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10+0 records in 2022-11-29T17:03:42.761 INFO:teuthology.orchestra.run.smithi182.stderr:10+0 records out 2022-11-29T17:03:42.762 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0165882 s, 632 MB/s 2022-11-29T17:03:42.762 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping successful for: 2022-11-29T17:03:43.256 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi182:/dev/nvme3n1 2022-11-29T17:03:43.862 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:42.241710+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:43.863 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:42.241710+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:44.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:43 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:42.241710+0000 mgr.y (mgr.14146) 69 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:45.265 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:43.866588+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:03:45.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:43.870970+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:43.871764+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:03:45.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:43.872266+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 16144M 2022-11-29T17:03:45.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:43.876980+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:43.882242+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:44.241954+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:45.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:43.866588+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:03:45.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:43.870970+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:43.871764+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:03:45.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:43.872266+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 16144M 2022-11-29T17:03:45.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:43.876980+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:43.882242+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:44.241954+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:45.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:43.866588+0000 mgr.y (mgr.14146) 70 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:03:45.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:43.870970+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:43.871764+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:03:45.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:43.872266+0000 mgr.y (mgr.14146) 71 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 16144M 2022-11-29T17:03:45.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:43.876980+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:43.882242+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:03:45.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:44.241954+0000 mgr.y (mgr.14146) 72 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:46.193 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:44.959096+0000 mgr.y (mgr.14146) 73 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:46.194 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:44.961026+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:46.195 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:44.962907+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:46.195 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:44.963395+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:46.197 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:44.959096+0000 mgr.y (mgr.14146) 73 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:46.198 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:44.961026+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:46.198 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:44.962907+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:46.199 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:44.963395+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:46.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:44.959096+0000 mgr.y (mgr.14146) 73 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:03:46.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:44.961026+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:03:46.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:44.962907+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:03:46.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:44.963395+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:47.198 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:46.242357+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:47.198 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:46.242357+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:47.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:46 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:46.242357+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:48.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:47.085973+0000 mon.a (mon.0) 252 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]: dispatch 2022-11-29T17:03:48.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:47.089706+0000 mon.a (mon.0) 253 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]': finished 2022-11-29T17:03:48.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:47.089760+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2022-11-29T17:03:48.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:47.089888+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:03:48.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:47.085973+0000 mon.a (mon.0) 252 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]: dispatch 2022-11-29T17:03:48.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:47.089706+0000 mon.a (mon.0) 253 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]': finished 2022-11-29T17:03:48.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:47.089760+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2022-11-29T17:03:48.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:47.089888+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:03:48.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:47.085973+0000 mon.a (mon.0) 252 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]: dispatch 2022-11-29T17:03:48.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:47.089706+0000 mon.a (mon.0) 253 : audit [INF] from='client.? 172.21.15.182:0/1763834802' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a01398d-ad7f-42a7-ae44-4e4056b7b4e4"}]': finished 2022-11-29T17:03:48.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:47.089760+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2022-11-29T17:03:48.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:47.089888+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:03:49.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:48.242661+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:49.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:48.307440+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.182:0/3737883240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:49.266 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:48.242661+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:49.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:48.307440+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.182:0/3737883240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:49.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:48 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:48.242661+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:49.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:48 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:48.307440+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.182:0/3737883240' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:03:51.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:50.242969+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:51.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:50.242969+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:50.242969+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:53.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:53 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:52.243385+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:53.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:52.243385+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:53.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:52.243385+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:54.556 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:53.393739+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-11-29T17:03:54.557 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:03:53.394396+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:54.557 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:03:53.394878+0000 mgr.y (mgr.14146) 78 : cephadm [INF] Deploying daemon osd.1 on smithi182 2022-11-29T17:03:54.558 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:53.393739+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-11-29T17:03:54.559 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:03:53.394396+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:54.559 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:03:53.394878+0000 mgr.y (mgr.14146) 78 : cephadm [INF] Deploying daemon osd.1 on smithi182 2022-11-29T17:03:54.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:53.393739+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-11-29T17:03:54.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:03:53.394396+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:03:54.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:03:53.394878+0000 mgr.y (mgr.14146) 78 : cephadm [INF] Deploying daemon osd.1 on smithi182 2022-11-29T17:03:55.491 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:54.243813+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:55.491 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:54.243813+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:55.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:55 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:54.243813+0000 mgr.y (mgr.14146) 79 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:57.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:56.244102+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:57.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:56.244102+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:57.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:56.244102+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:59.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:03:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:03:58.244384+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:59.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:03:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:03:58.244384+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:03:59.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:03:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:03:58.244384+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:01.463 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:00.244684+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:01.464 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:00.244684+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:01.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:00.244684+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:02.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:01.595649+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:02.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:01.631665+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:02.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:01.632672+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:02.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:01.633173+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:02.771 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:01.595649+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:02.772 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:01.631665+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:02.772 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:01.632672+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:02.773 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:01.633173+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:03.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:01.595649+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:03.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:01.631665+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:03.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:01.632672+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:03.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:01.633173+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:03.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:02.245043+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:03.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:02.245043+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:04.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:02.245043+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:05.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:03.982425+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:03.986347+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:04.245358+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:05.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:04.721883+0000 mon.a (mon.0) 265 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-11-29T17:04:05.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:03.982425+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:03.986347+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:04.245358+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:05.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:04.721883+0000 mon.a (mon.0) 265 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-11-29T17:04:05.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:03.982425+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:03.986347+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:05.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:04.245358+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:05.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:04.721883+0000 mon.a (mon.0) 265 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-11-29T17:04:06.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:04.989435+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-11-29T17:04:06.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:04.989498+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-11-29T17:04:06.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:04.989608+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:06.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:04.990025+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:06.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:04.989435+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-11-29T17:04:06.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:04.989498+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-11-29T17:04:06.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:04.989608+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:06.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:04.990025+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:06.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:04.989435+0000 mon.a (mon.0) 266 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-11-29T17:04:06.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:04.989498+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-11-29T17:04:06.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:04.989608+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:06.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:04.990025+0000 mon.a (mon.0) 269 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:07.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:05.990955+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:07.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:05.991023+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-11-29T17:04:07.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:05.991414+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:05.995641+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:06.245664+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:07.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:05.990955+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:07.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:05.991023+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-11-29T17:04:07.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:05.991414+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:05.995641+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:06.245664+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:07.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:05.990955+0000 mon.a (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:07.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:05.991023+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-11-29T17:04:07.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:05.991414+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:05.995641+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:07.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:06.245664+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-11-29T17:04:07.576 INFO:teuthology.orchestra.run.smithi182.stdout:Created osd(s) 1 on host 'smithi182' 2022-11-29T17:04:08.089 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:05.696592+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:08.089 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:05.696727+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:08.090 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:06.996119+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.090 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:07.003891+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822] boot 2022-11-29T17:04:08.090 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:07.003918+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2022-11-29T17:04:08.091 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:07.004369+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.091 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:07.574199+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:08.092 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:07.607893+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:08.092 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:07.608879+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:08.093 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:07.609446+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:08.094 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:05.696592+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:08.094 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:05.696727+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:08.095 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:06.996119+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.095 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:07.003891+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822] boot 2022-11-29T17:04:08.095 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:07.003918+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2022-11-29T17:04:08.096 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:07.004369+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.096 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:07.574199+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:08.097 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:07.607893+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:08.097 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:07.608879+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:08.097 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:07.609446+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:08.099 DEBUG:teuthology.orchestra.run.smithi182:osd.1> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.1.service 2022-11-29T17:04:08.104 INFO:tasks.cephadm:Deploying osd.2 on smithi182 with /dev/nvme2n1... 2022-11-29T17:04:08.104 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme2n1 2022-11-29T17:04:08.132 INFO:journalctl@ceph.osd.1.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:04:08.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:05.696592+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:08.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:05.696727+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:08.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:06.996119+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:07.003891+0000 mon.a (mon.0) 275 : cluster [INF] osd.1 [v2:172.21.15.182:6810/850909822,v1:172.21.15.182:6811/850909822] boot 2022-11-29T17:04:08.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:07.003918+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2022-11-29T17:04:08.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:07.004369+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-11-29T17:04:08.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:07.574199+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:08.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:07.607893+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:08.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:07.608879+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:08.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:07.609446+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:09.098 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:08.245949+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:09.098 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:08.364642+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:04:09.099 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:08.365512+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:04:09.099 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:08.575785+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-11-29T17:04:09.100 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:08.245949+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:09.100 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:08.364642+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:04:09.100 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:08.365512+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:04:09.100 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:08.575785+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-11-29T17:04:09.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:08.245949+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:09.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:08.364642+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:04:09.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:08.365512+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:04:09.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:08.575785+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-11-29T17:04:10.569 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping: /dev/nvme2n1 2022-11-29T17:04:10.570 INFO:teuthology.orchestra.run.smithi182.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:04:10.570 INFO:teuthology.orchestra.run.smithi182.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme2n1 bs=1M count=10 conv=fsync 2022-11-29T17:04:10.570 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10+0 records in 2022-11-29T17:04:10.570 INFO:teuthology.orchestra.run.smithi182.stderr:10+0 records out 2022-11-29T17:04:10.570 INFO:teuthology.orchestra.run.smithi182.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0138444 s, 757 MB/s 2022-11-29T17:04:10.571 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping successful for: 2022-11-29T17:04:11.035 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi182:/dev/nvme2n1 2022-11-29T17:04:11.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:10.246237+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:11.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:11.066150+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:11.067075+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:11.067689+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:11.072036+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:11.075892+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:10.246237+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:11.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:11.066150+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:11.067075+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.269 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:11.067689+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:11.072036+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:11.075892+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:10.246237+0000 mgr.y (mgr.14146) 87 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:11.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:11.066150+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:11.067075+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:11.067689+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:11.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:11.072036+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:11.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:11.075892+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:12.515 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:11.061493+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:12.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:11.068106+0000 mgr.y (mgr.14146) 89 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 8072M 2022-11-29T17:04:12.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:11.061493+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:12.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:11.068106+0000 mgr.y (mgr.14146) 89 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 8072M 2022-11-29T17:04:12.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:11.061493+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:12.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:11.068106+0000 mgr.y (mgr.14146) 89 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 8072M 2022-11-29T17:04:13.488 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:12.246544+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:13.488 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:12.666412+0000 mgr.y (mgr.14146) 91 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:13.489 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:12.668392+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:13.489 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:12.670182+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:13.489 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:12.670714+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:13.490 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:12.246544+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:13.490 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:12.666412+0000 mgr.y (mgr.14146) 91 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:13.490 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:12.668392+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:13.491 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:12.670182+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:13.491 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:12.670714+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:13.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:12.246544+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:13.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:12.666412+0000 mgr.y (mgr.14146) 91 : audit [DBG] from='client.14259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:13.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:12.668392+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:13.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:12.670182+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:13.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:12.670714+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:15.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:14.246924+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:15.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:15.040869+0000 mon.a (mon.0) 293 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]: dispatch 2022-11-29T17:04:15.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:15.045417+0000 mon.a (mon.0) 294 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]': finished 2022-11-29T17:04:15.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:15.045466+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2022-11-29T17:04:15.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:15.045568+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:15.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:14.246924+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:15.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:15.040869+0000 mon.a (mon.0) 293 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]: dispatch 2022-11-29T17:04:15.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:15.045417+0000 mon.a (mon.0) 294 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]': finished 2022-11-29T17:04:15.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:15.045466+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2022-11-29T17:04:15.521 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:15.045568+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:15.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:14.246924+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:15.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:15.040869+0000 mon.a (mon.0) 293 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]: dispatch 2022-11-29T17:04:15.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:15.045417+0000 mon.a (mon.0) 294 : audit [INF] from='client.? 172.21.15.182:0/3374042202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "429dd6a7-b87f-4031-9278-d9f8462bf109"}]': finished 2022-11-29T17:04:15.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:15.045466+0000 mon.a (mon.0) 295 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2022-11-29T17:04:15.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:15.045568+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:17.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:16.247249+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:17.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:16.308613+0000 mon.a (mon.0) 297 : audit [DBG] from='client.? 172.21.15.182:0/3455320212' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:17.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:16.247249+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:17.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:16.308613+0000 mon.a (mon.0) 297 : audit [DBG] from='client.? 172.21.15.182:0/3455320212' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:17.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:16.247249+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:17.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:16.308613+0000 mon.a (mon.0) 297 : audit [DBG] from='client.? 172.21.15.182:0/3455320212' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:19.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:18.247498+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:19.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:18.247498+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:19.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:18.247498+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:21.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:20.247897+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:20.247897+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:21.584 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:20.247897+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:22.503 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:21.519464+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-11-29T17:04:22.504 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:21.520062+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:22.505 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:21.520593+0000 mgr.y (mgr.14146) 96 : cephadm [INF] Deploying daemon osd.2 on smithi182 2022-11-29T17:04:22.505 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:21.519464+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-11-29T17:04:22.506 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:21.520062+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:22.506 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:22 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:21.520593+0000 mgr.y (mgr.14146) 96 : cephadm [INF] Deploying daemon osd.2 on smithi182 2022-11-29T17:04:22.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:22 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:21.519464+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-11-29T17:04:22.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:22 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:21.520062+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:22.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:22 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:21.520593+0000 mgr.y (mgr.14146) 96 : cephadm [INF] Deploying daemon osd.2 on smithi182 2022-11-29T17:04:23.226 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:22.248151+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:23.515 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:22.248151+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:23.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:23 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:22.248151+0000 mgr.y (mgr.14146) 97 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:25.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:24.248454+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:25.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:24.248454+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:25.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:24.248454+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:27.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:26.248706+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:27.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:26.248706+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:27.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:26.248706+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:29.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:28.248950+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:29.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:28.248950+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:29.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:28.248950+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:31.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:30.249168+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:31.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:30.250706+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:31.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:30.276882+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:31.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:30.277841+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:31.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:30.278390+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:31.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:30.249168+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:31.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:30.250706+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:31.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:30.276882+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:31.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:30.277841+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:31.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:30.278390+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:31.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:30.249168+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:31.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:30.250706+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:31.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:30.276882+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:31.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:30.277841+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:31.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:30.278390+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:34.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:32.249388+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:34.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:32.706545+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:32.710747+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.455806+0000 mon.c (mon.2) 4 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:34.018 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.456183+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:34.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:32.249388+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:34.023 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:32.706545+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.024 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:32.710747+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.024 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.455806+0000 mon.c (mon.2) 4 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:34.025 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.456183+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:34.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:32.249388+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:34.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:32.706545+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:32.710747+0000 mon.a (mon.0) 305 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:34.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.455806+0000 mon.c (mon.2) 4 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:34.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.456183+0000 mon.a (mon.0) 306 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-11-29T17:04:35.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.712907+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-11-29T17:04:35.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:33.712980+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-11-29T17:04:35.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.713083+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:35.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.713917+0000 mon.c (mon.2) 5 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:35.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:33.714253+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:35.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.712907+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-11-29T17:04:35.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:33.712980+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-11-29T17:04:35.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.713083+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:35.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.713917+0000 mon.c (mon.2) 5 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:35.020 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:33.714253+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:35.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.712907+0000 mon.a (mon.0) 307 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-11-29T17:04:35.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:33.712980+0000 mon.a (mon.0) 308 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-11-29T17:04:35.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.713083+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:35.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.713917+0000 mon.c (mon.2) 5 : audit [INF] from='osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:35.083 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:33.714253+0000 mon.a (mon.0) 310 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:04:36.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:34.249630+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:36.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:34.714114+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:36.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:34.714206+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-11-29T17:04:36.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:34.714538+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:34.718394+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:34.249630+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:36.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:34.714114+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:36.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:34.714206+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-11-29T17:04:36.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:34.714538+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:34.718394+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:34.249630+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v79: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:36.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:34.714114+0000 mon.a (mon.0) 311 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:04:36.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:34.714206+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-11-29T17:04:36.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:34.714538+0000 mon.a (mon.0) 313 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:34.718394+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:36.643 INFO:teuthology.orchestra.run.smithi182.stdout:Created osd(s) 2 on host 'smithi182' 2022-11-29T17:04:37.086 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:34.433210+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:37.086 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:34.433354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:37.086 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:35.719815+0000 mon.a (mon.0) 315 : cluster [INF] osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846] boot 2022-11-29T17:04:37.087 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:35.719849+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2022-11-29T17:04:37.087 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:35.720249+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:37.087 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.640935+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:37.087 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:34.433210+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:37.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:34.433354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:37.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:35.719815+0000 mon.a (mon.0) 315 : cluster [INF] osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846] boot 2022-11-29T17:04:37.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:35.719849+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2022-11-29T17:04:37.088 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:35.720249+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:37.089 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.640935+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:37.111 DEBUG:teuthology.orchestra.run.smithi182:osd.2> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.2.service 2022-11-29T17:04:37.125 INFO:tasks.cephadm:Deploying osd.3 on smithi182 with /dev/nvme1n1... 2022-11-29T17:04:37.125 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme1n1 2022-11-29T17:04:37.155 INFO:journalctl@ceph.osd.2.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:04:37.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:34.433210+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:04:37.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:34.433354+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:04:37.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:35.719815+0000 mon.a (mon.0) 315 : cluster [INF] osd.2 [v2:172.21.15.182:6818/1462250846,v1:172.21.15.182:6819/1462250846] boot 2022-11-29T17:04:37.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:35.719849+0000 mon.a (mon.0) 316 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2022-11-29T17:04:37.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:35.720249+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-11-29T17:04:37.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.640935+0000 mon.a (mon.0) 318 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:38.026 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:36.250036+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:38.026 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.642263+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2022-11-29T17:04:38.027 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.890148+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:38.027 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.893110+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:38.028 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.893798+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:38.028 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.897572+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2022-11-29T17:04:38.029 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:36.897640+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-11-29T17:04:38.029 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:36.899052+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-11-29T17:04:38.030 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:36.250036+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:38.031 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.642263+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2022-11-29T17:04:38.031 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.890148+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:38.032 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.893110+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:38.032 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.893798+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:38.032 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.897572+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2022-11-29T17:04:38.033 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:36.897640+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-11-29T17:04:38.033 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:36.899052+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-11-29T17:04:38.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:36.250036+0000 mgr.y (mgr.14146) 104 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-11-29T17:04:38.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.642263+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2022-11-29T17:04:38.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.890148+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:04:38.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.893110+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:38.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.893798+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:04:38.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.897572+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2022-11-29T17:04:38.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:36.897640+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-11-29T17:04:38.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:36.899052+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-11-29T17:04:39.234 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:37.902880+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-11-29T17:04:39.235 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:37.902944+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2022-11-29T17:04:39.235 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:38.250367+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:39.236 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:38.899088+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2022-11-29T17:04:39.237 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:37.902880+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-11-29T17:04:39.237 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:37.902944+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2022-11-29T17:04:39.237 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:38.250367+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:39.238 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:38.899088+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2022-11-29T17:04:39.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:37.902880+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-11-29T17:04:39.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:37.902944+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2022-11-29T17:04:39.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:38.250367+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:39.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:38.899088+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2022-11-29T17:04:39.905 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping: /dev/nvme1n1 2022-11-29T17:04:39.905 INFO:teuthology.orchestra.run.smithi182.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:04:39.905 INFO:teuthology.orchestra.run.smithi182.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2022-11-29T17:04:39.906 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10+0 records in 2022-11-29T17:04:39.906 INFO:teuthology.orchestra.run.smithi182.stderr:10+0 records out 2022-11-29T17:04:39.906 INFO:teuthology.orchestra.run.smithi182.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0160466 s, 653 MB/s 2022-11-29T17:04:39.906 INFO:teuthology.orchestra.run.smithi182.stderr:--> Zapping successful for: 2022-11-29T17:04:40.565 DEBUG:teuthology.orchestra.run.smithi182:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi182:/dev/nvme1n1 2022-11-29T17:04:41.730 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:40.250659+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:41.730 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:40.657204+0000 mgr.y (mgr.14146) 107 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:41.731 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.662077+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:41.731 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.969591+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.731 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.970203+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.731 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.970740+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.732 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.976857+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:41.732 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:40.982680+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:41.732 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:40.250659+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:41.733 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:40.657204+0000 mgr.y (mgr.14146) 107 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:41.733 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.662077+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:41.733 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.969591+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.733 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.970203+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.734 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.970740+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:41.734 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.976857+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:41.734 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:40.982680+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:42.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:40.250659+0000 mgr.y (mgr.14146) 106 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:42.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:40.657204+0000 mgr.y (mgr.14146) 107 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:04:42.090 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.662077+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:42.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.969591+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:42.091 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.970203+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:42.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.970740+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:04:42.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.976857+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:42.092 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:40.982680+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:04:43.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:40.971130+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 5381M 2022-11-29T17:04:43.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:42.306926+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:43.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:42.308753+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:43.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:42.309268+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:43.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:40.971130+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 5381M 2022-11-29T17:04:43.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:42.306926+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:43.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:42.308753+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:43.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:42.309268+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:43.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:42 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:40.971130+0000 mgr.y (mgr.14146) 108 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 5381M 2022-11-29T17:04:43.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:42 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:42.306926+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:04:43.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:42 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:42.308753+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:04:43.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:42 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:42.309268+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:43.867 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:42.250973+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:43.868 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:42.305009+0000 mgr.y (mgr.14146) 110 : audit [DBG] from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:43.868 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:42.250973+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:43.868 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:42.305009+0000 mgr.y (mgr.14146) 110 : audit [DBG] from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:44.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:43 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:42.250973+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:44.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:43 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:42.305009+0000 mgr.y (mgr.14146) 110 : audit [DBG] from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi182:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:04:45.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:44.553673+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.182:0/3026487241' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:44.553989+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:44.562785+0000 mon.a (mon.0) 339 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]': finished 2022-11-29T17:04:45.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:44.562855+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-11-29T17:04:45.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:44.562971+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:04:45.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:44.553673+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.182:0/3026487241' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:44.553989+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:44.562785+0000 mon.a (mon.0) 339 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]': finished 2022-11-29T17:04:45.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:44.562855+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-11-29T17:04:45.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:44 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:44.562971+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:04:45.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:44.553673+0000 mon.c (mon.2) 6 : audit [INF] from='client.? 172.21.15.182:0/3026487241' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:44.553989+0000 mon.a (mon.0) 338 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]: dispatch 2022-11-29T17:04:45.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:44.562785+0000 mon.a (mon.0) 339 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97cd0a6e-160f-4872-85eb-71ab26d63184"}]': finished 2022-11-29T17:04:45.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:44.562855+0000 mon.a (mon.0) 340 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-11-29T17:04:45.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:44 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:44.562971+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:04:46.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:44.251282+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:46.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:44.251282+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:46.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:44.251282+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:47.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:45.848777+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.182:0/2068309111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:47.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:46 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:45.848777+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.182:0/2068309111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:47.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:46 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:45.848777+0000 mon.c (mon.2) 7 : audit [DBG] from='client.? 172.21.15.182:0/2068309111' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:04:48.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:46.251622+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:48.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:46.251622+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:48.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:46.251622+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:49.966 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:48.251939+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:49.966 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:48.251939+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:50.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:49 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:48.251939+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:51.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:50.252585+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:51.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:51.044912+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-11-29T17:04:51.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:04:51.045525+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:51.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:50.252585+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:51.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:51.044912+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-11-29T17:04:51.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:04:51.045525+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:50.252585+0000 mgr.y (mgr.14146) 114 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:51.044912+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-11-29T17:04:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:04:51.045525+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:04:52.510 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:04:51.045999+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Deploying daemon osd.3 on smithi182 2022-11-29T17:04:52.511 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:52 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:04:51.045999+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Deploying daemon osd.3 on smithi182 2022-11-29T17:04:52.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:52 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:04:51.045999+0000 mgr.y (mgr.14146) 115 : cephadm [INF] Deploying daemon osd.3 on smithi182 2022-11-29T17:04:53.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:52.252921+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:53.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:52.252921+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:53.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:53 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:52.252921+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:55.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:55 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:54.253453+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:55.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:54.253453+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:55.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:54.253453+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:57.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:56.253759+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:57.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:56.253759+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:57.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:56.253759+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:59.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:04:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:04:58.254067+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:59.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:04:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:04:58.254067+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:04:59.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:04:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:04:58.254067+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:01.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:00.254449+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:01.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:00.383505+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:01.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:00.385563+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:01.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:00.387113+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:01.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:00.388124+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:01.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:00.254449+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:01.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:00.383505+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:01.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:00.385563+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:01.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:00.387113+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:01.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:01 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:00.388124+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:01.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:00.254449+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:01.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:00.383505+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:01.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:00.385563+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:01.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:00.387113+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:01.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:01 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:00.388124+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:03.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:02.254758+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:03.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:03.035001+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:03.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:03.038713+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:03.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:02.254758+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:03.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:03.035001+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:03.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:03.038713+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:03.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:02.254758+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:03.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:03.035001+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:03.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:03.038713+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:04.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:03.606320+0000 mon.c (mon.2) 8 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:04.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:03.606671+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:04.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:03.606320+0000 mon.c (mon.2) 8 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:04.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:04 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:03.606671+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:04.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:03.606320+0000 mon.c (mon.2) 8 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:04.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:04 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:03.606671+0000 mon.a (mon.0) 350 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-11-29T17:05:05.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:04.255033+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:05.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:04.393919+0000 mon.a (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-11-29T17:05:05.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:04.393996+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-11-29T17:05:05.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:04.394123+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:05.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:04.394739+0000 mon.c (mon.2) 9 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:05.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:04.395056+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:05.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:04.255033+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:05.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:04.393919+0000 mon.a (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-11-29T17:05:05.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:04.393996+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-11-29T17:05:05.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:04.394123+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:05.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:04.394739+0000 mon.c (mon.2) 9 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:05.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:04.395056+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:05.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:04.255033+0000 mgr.y (mgr.14146) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:05.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:04.393919+0000 mon.a (mon.0) 351 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-11-29T17:05:05.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:04.393996+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-11-29T17:05:05.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:04.394123+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:05.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:04.394739+0000 mon.c (mon.2) 9 : audit [INF] from='osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:05.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:04.395056+0000 mon.a (mon.0) 354 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]: dispatch 2022-11-29T17:05:06.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:05.394657+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:05:06.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:05.394712+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-11-29T17:05:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:05.395117+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:05.399629+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:06.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:05.394657+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:05:06.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:05.394712+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-11-29T17:05:06.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:05.395117+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:06.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:05.399629+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:06.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:05.394657+0000 mon.a (mon.0) 355 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi182", "root=default"]}]': finished 2022-11-29T17:05:06.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:05.394712+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-11-29T17:05:06.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:05.395117+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:06.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:05.399629+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.480 INFO:teuthology.orchestra.run.smithi182.stdout:Created osd(s) 3 on host 'smithi182' 2022-11-29T17:05:07.654 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:04.559983+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:07.655 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:04.560076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:07.655 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:06.255312+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:07.655 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:06.399513+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.655 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:06.402850+0000 mon.a (mon.0) 360 : cluster [INF] osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445] boot 2022-11-29T17:05:07.655 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:06.402903+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2022-11-29T17:05:07.656 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:06.403308+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.656 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:04.559983+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:07.657 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:04.560076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:07.657 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:06.255312+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:07.657 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:06.399513+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.657 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:06.402850+0000 mon.a (mon.0) 360 : cluster [INF] osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445] boot 2022-11-29T17:05:07.658 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:06.402903+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2022-11-29T17:05:07.658 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:06.403308+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:04.559983+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:07.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:04.560076+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:07.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:06.255312+0000 mgr.y (mgr.14146) 123 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-11-29T17:05:07.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:06.399513+0000 mon.a (mon.0) 359 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:07.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:06.402850+0000 mon.a (mon.0) 360 : cluster [INF] osd.3 [v2:172.21.15.182:6826/336767445,v1:172.21.15.182:6827/336767445] boot 2022-11-29T17:05:07.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:06.402903+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2022-11-29T17:05:07.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:06.403308+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-11-29T17:05:08.065 DEBUG:teuthology.orchestra.run.smithi182:osd.3> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.3.service 2022-11-29T17:05:08.068 INFO:tasks.cephadm:Deploying osd.4 on smithi191 with /dev/nvme4n1... 2022-11-29T17:05:08.068 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1 2022-11-29T17:05:08.098 INFO:journalctl@ceph.osd.3.smithi182.stdout:-- Logs begin at Tue 2022-11-29 16:52:10 UTC. -- 2022-11-29T17:05:08.673 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:07.413279+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2022-11-29T17:05:08.673 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:07.478348+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:08.673 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:07.511927+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:08.674 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:07.512826+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:08.674 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:07.513382+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:08.674 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:08.365817+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:05:08.674 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:08.366187+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:05:08.675 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:07.413279+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2022-11-29T17:05:08.675 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:07.478348+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:08.676 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:07.511927+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:08.676 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:07.512826+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:08.676 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:07.513382+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:08.676 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:08.365817+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:05:08.677 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:08.366187+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:05:08.768 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:07.413279+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2022-11-29T17:05:08.769 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:07.478348+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:08.769 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:07.511927+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:08.769 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:07.512826+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:08.770 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:07.513382+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:08.770 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:08.365817+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:05:08.770 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:08.366187+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:05:09.483 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:08.255618+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:09.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:08.255618+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:08.255618+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:09.872 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/nvme4n1 2022-11-29T17:05:09.873 INFO:teuthology.orchestra.run.smithi191.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:05:09.873 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme4n1 bs=1M count=10 conv=fsync 2022-11-29T17:05:09.873 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2022-11-29T17:05:09.874 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2022-11-29T17:05:09.874 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0138055 s, 760 MB/s 2022-11-29T17:05:09.874 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2022-11-29T17:05:10.281 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi191:/dev/nvme4n1 2022-11-29T17:05:11.357 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:10.255965+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:11.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.009567+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.010549+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.358 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.011171+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.011729+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.012251+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.359 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.015772+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.360 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.021096+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:10.255965+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:11.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.009567+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.010549+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.011171+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.011729+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.012251+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.015772+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.021096+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:10.255965+0000 mgr.y (mgr.14146) 125 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:11.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.009567+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.010549+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.011171+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.011729+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.012251+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:11.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.015772+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:11.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.021096+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:12.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:11.004906+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:05:12.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:11.012656+0000 mgr.y (mgr.14146) 127 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 4036M 2022-11-29T17:05:12.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.949850+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:12.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.952242+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:12.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.953017+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:12.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:11.004906+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:05:12.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:11.012656+0000 mgr.y (mgr.14146) 127 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 4036M 2022-11-29T17:05:12.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.949850+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:12.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.952242+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:12.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:12 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.953017+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:12.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:11.004906+0000 mgr.y (mgr.14146) 126 : cephadm [INF] Detected new or changed devices on smithi182 2022-11-29T17:05:12.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:11.012656+0000 mgr.y (mgr.14146) 127 : cephadm [INF] Adjusting osd_memory_target on smithi182 to 4036M 2022-11-29T17:05:12.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.949850+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:12.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.952242+0000 mon.a (mon.0) 378 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:12.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:12 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.953017+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:13.304 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:11.947185+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:13.305 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:12.256378+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:13.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:11.947185+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:13.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:12.256378+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:13.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:11.947185+0000 mgr.y (mgr.14146) 128 : audit [DBG] from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme4n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:13.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:12.256378+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:15.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:14.256709+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:15.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:14.321131+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.191:0/3081740432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:14.321543+0000 mon.a (mon.0) 380 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:14.327005+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]': finished 2022-11-29T17:05:15.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:14.327104+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2022-11-29T17:05:15.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:14.327256+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:15.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:14.256709+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:15.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:14.321131+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.191:0/3081740432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:14.321543+0000 mon.a (mon.0) 380 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:14.327005+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]': finished 2022-11-29T17:05:15.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:14.327104+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2022-11-29T17:05:15.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:14.327256+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:15.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:14.256709+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:15.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:14.321131+0000 mon.b (mon.1) 7 : audit [INF] from='client.? 172.21.15.191:0/3081740432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:14.321543+0000 mon.a (mon.0) 380 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]: dispatch 2022-11-29T17:05:15.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:14.327005+0000 mon.a (mon.0) 381 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a7c54ad-7c30-46d4-9c7d-0f3cd53c3e17"}]': finished 2022-11-29T17:05:15.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:14.327104+0000 mon.a (mon.0) 382 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2022-11-29T17:05:15.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:14.327256+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:16.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:16 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:15.648842+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.191:0/3303460880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:16.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:16 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:15.648842+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.191:0/3303460880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:16.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:16 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:15.648842+0000 mon.b (mon.1) 8 : audit [DBG] from='client.? 172.21.15.191:0/3303460880' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:17.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:16.257184+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:17.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:16.257184+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:17.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:16.257184+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:19.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:18.257712+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:19.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:18.257712+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:19.773 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:18.257712+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:21.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:20.258074+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:21.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:20.690959+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-11-29T17:05:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:20.691789+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:20.692443+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Deploying daemon osd.4 on smithi191 2022-11-29T17:05:21.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:20.258074+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:21.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:20.690959+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-11-29T17:05:21.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:20.691789+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:21.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:20.692443+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Deploying daemon osd.4 on smithi191 2022-11-29T17:05:21.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:20.258074+0000 mgr.y (mgr.14146) 133 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:21.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:20.690959+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-11-29T17:05:21.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:20.691789+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:21.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:20.692443+0000 mgr.y (mgr.14146) 134 : cephadm [INF] Deploying daemon osd.4 on smithi191 2022-11-29T17:05:23.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:23 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:22.258566+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:23.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:22.258566+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:23.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:22.258566+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:25.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:24.259096+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:25.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:24.259096+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:25.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:24.259096+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:27.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:26.259537+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:27.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:26.259537+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:27.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:26.259537+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:29.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:28.259937+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:29.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:28.283942+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:29.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:28.329503+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:29.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:28.330715+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:29.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:28.331511+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:29.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:28.259937+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:29.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:28.283942+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:29.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:28.329503+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:29.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:28.330715+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:29.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:28.331511+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:29.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:28.259937+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:29.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:28.283942+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:29.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:28.329503+0000 mon.a (mon.0) 387 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:29.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:28.330715+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:29.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:28.331511+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:31.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:30.216855+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:30.221538+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:30.260358+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:31.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:30.216855+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:30.221538+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:30.260358+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:31.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:30.216855+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:30.221538+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:31.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:30.260358+0000 mgr.y (mgr.14146) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:32.525 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:31.466866+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:32.525 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:31.467340+0000 mon.a (mon.0) 392 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:32.526 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:31.466866+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:32.526 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:32 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:31.467340+0000 mon.a (mon.0) 392 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:32.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:32 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:31.466866+0000 mon.b (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:32.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:32 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:31.467340+0000 mon.a (mon.0) 392 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-11-29T17:05:33.515 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:32.238247+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-11-29T17:05:33.515 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:32.238329+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-11-29T17:05:33.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:32.238449+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:33.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:32.238970+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:32.239410+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:32.260688+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:33.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:32.238247+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-11-29T17:05:33.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:32.238329+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-11-29T17:05:33.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:32.238449+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:33.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:32.238970+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:32.239410+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:32.260688+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:33.525 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 4 on host 'smithi191' 2022-11-29T17:05:33.554 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:32.238247+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-11-29T17:05:33.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:32.238329+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-11-29T17:05:33.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:32.238449+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:33.555 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:32.238970+0000 mon.b (mon.1) 10 : audit [INF] from='osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:32.239410+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:05:33.556 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:32.260688+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-11-29T17:05:33.955 DEBUG:teuthology.orchestra.run.smithi191:osd.4> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.4.service 2022-11-29T17:05:33.957 INFO:tasks.cephadm:Deploying osd.5 on smithi191 with /dev/nvme3n1... 2022-11-29T17:05:33.958 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme3n1 2022-11-29T17:05:33.988 INFO:journalctl@ceph.osd.4.smithi191.stdout:-- Logs begin at Tue 2022-11-29 16:52:25 UTC. -- 2022-11-29T17:05:34.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.238518+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:05:34.512 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:33.238618+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-11-29T17:05:34.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.241624+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:34.513 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.523493+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:34.514 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.544756+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:34.514 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.546113+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:34.515 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:34 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:33.547028+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:34.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.238518+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:05:34.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:33.238618+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-11-29T17:05:34.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.241624+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:34.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.523493+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:34.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.544756+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:34.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.546113+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:34.518 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:33.547028+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:34.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.238518+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:05:34.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:33.238618+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-11-29T17:05:34.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.241624+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:34.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.523493+0000 mon.a (mon.0) 400 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:34.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.544756+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:34.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.546113+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:34.521 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:34 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:33.547028+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:35.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:32.425668+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:35.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:32.425762+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:35.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:34.245688+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941] boot 2022-11-29T17:05:35.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:34.245748+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2022-11-29T17:05:35.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:34.246516+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:35.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:34.261071+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:35.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:35.230958+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-11-29T17:05:35.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:32.425668+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:35.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:32.425762+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:35.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:34.245688+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941] boot 2022-11-29T17:05:35.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:34.245748+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2022-11-29T17:05:35.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:34.246516+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:35.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:34.261071+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:35.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:35.230958+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-11-29T17:05:35.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:32.425668+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:05:35.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:32.425762+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:05:35.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:34.245688+0000 mon.a (mon.0) 404 : cluster [INF] osd.4 [v2:172.21.15.191:6800/4105789941,v1:172.21.15.191:6801/4105789941] boot 2022-11-29T17:05:35.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:34.245748+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2022-11-29T17:05:35.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:34.246516+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-11-29T17:05:35.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:34.261071+0000 mgr.y (mgr.14146) 141 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:35.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:35.230958+0000 mon.a (mon.0) 407 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-11-29T17:05:36.380 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/nvme3n1 2022-11-29T17:05:36.381 INFO:teuthology.orchestra.run.smithi191.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:05:36.382 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme3n1 bs=1M count=10 conv=fsync 2022-11-29T17:05:36.382 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2022-11-29T17:05:36.382 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2022-11-29T17:05:36.383 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0167553 s, 626 MB/s 2022-11-29T17:05:36.384 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2022-11-29T17:05:36.882 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi191:/dev/nvme3n1 2022-11-29T17:05:37.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:36.230544+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-11-29T17:05:37.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:36.261475+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:37.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:36.230544+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-11-29T17:05:37.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:36.261475+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:37.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:36.230544+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-11-29T17:05:37.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:36.261475+0000 mgr.y (mgr.14146) 142 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:38.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:37.455432+0000 mgr.y (mgr.14146) 143 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:05:38.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:37.461800+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:37.462819+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:38.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:37.463487+0000 mgr.y (mgr.14146) 144 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 17168M 2022-11-29T17:05:38.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:37.468529+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:37.473110+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:37.455432+0000 mgr.y (mgr.14146) 143 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:05:38.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:37.461800+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:37.462819+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:38.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:37.463487+0000 mgr.y (mgr.14146) 144 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 17168M 2022-11-29T17:05:38.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:37.468529+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:37.473110+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:37.455432+0000 mgr.y (mgr.14146) 143 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:05:38.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:37.461800+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:37.462819+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:05:38.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:37.463487+0000 mgr.y (mgr.14146) 144 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 17168M 2022-11-29T17:05:38.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:37.468529+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:38.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:37.473110+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:39.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:38.261792+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:39.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:38.618131+0000 mgr.y (mgr.14146) 146 : audit [DBG] from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:39.700 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:38.620396+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:39.701 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:38.622783+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:39.701 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:38.623534+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:39.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:38.261792+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:39.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:38.618131+0000 mgr.y (mgr.14146) 146 : audit [DBG] from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:39.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:38.620396+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:39.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:38.622783+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:39.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:38.623534+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:39.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:38.261792+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:39.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:38.618131+0000 mgr.y (mgr.14146) 146 : audit [DBG] from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme3n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:05:39.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:38.620396+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:05:39.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:38.622783+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:05:39.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:38.623534+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:41.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:40.262200+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:41.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:40.938179+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/1894258545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:40.938576+0000 mon.a (mon.0) 416 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:40.944579+0000 mon.a (mon.0) 417 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]': finished 2022-11-29T17:05:41.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:40.944659+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-11-29T17:05:41.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:40.944831+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:05:41.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:40.262200+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:41.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:40.938179+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/1894258545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:40.938576+0000 mon.a (mon.0) 416 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:40.944579+0000 mon.a (mon.0) 417 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]': finished 2022-11-29T17:05:41.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:40.944659+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-11-29T17:05:41.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:40.944831+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:05:41.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:40.262200+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:41.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:40.938179+0000 mon.b (mon.1) 11 : audit [INF] from='client.? 172.21.15.191:0/1894258545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:40.938576+0000 mon.a (mon.0) 416 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]: dispatch 2022-11-29T17:05:41.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:40.944579+0000 mon.a (mon.0) 417 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0798b1dc-77cf-44d1-b82b-e9bae44837f7"}]': finished 2022-11-29T17:05:41.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:40.944659+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-11-29T17:05:41.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:40.944831+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:05:42.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:42 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:42.252146+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.191:0/2465628690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:42.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:42.252146+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.191:0/2465628690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:42.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:42 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:42.252146+0000 mon.b (mon.1) 12 : audit [DBG] from='client.? 172.21.15.191:0/2465628690' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:05:43.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:43 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:42.262591+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:43.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:42.262591+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:43.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:42.262591+0000 mgr.y (mgr.14146) 148 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:45.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:44.263092+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:45.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:44.263092+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:45.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:44.263092+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:47.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:46.263463+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:47.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:46.263463+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:47.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:46.263463+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:48.653 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:48 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:47.459924+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-11-29T17:05:48.654 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:48 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:47.460879+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:48.654 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:48 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:05:47.461570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Deploying daemon osd.5 on smithi191 2022-11-29T17:05:48.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:47.459924+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-11-29T17:05:48.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:47.460879+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:48.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:05:47.461570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Deploying daemon osd.5 on smithi191 2022-11-29T17:05:48.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:47.459924+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-11-29T17:05:48.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:47.460879+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:48.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:48 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:05:47.461570+0000 mgr.y (mgr.14146) 151 : cephadm [INF] Deploying daemon osd.5 on smithi191 2022-11-29T17:05:49.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:49 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:48.263804+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:49.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:48.263804+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:49.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:48.263804+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:51.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:50.264177+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:51.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:50.264177+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:50.264177+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:53.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:53 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:52.264497+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:53.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:52.264497+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:53.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:52.264497+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:55.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:55 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:54.264844+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:55.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:54.264844+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:55.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:54.264844+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:56.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:55.654666+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:56.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:55.683506+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:56.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:55.684750+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:56.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:56 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:55.685561+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:57.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:55.654666+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:57.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:55.683506+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:57.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:55.684750+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:57.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:55.685561+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:57.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:55.654666+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:57.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:55.683506+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:05:57.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:55.684750+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:05:57.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:56 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:55.685561+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:05:57.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:56.265377+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:58.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:56.265377+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:58.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:57 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:56.265377+0000 mgr.y (mgr.14146) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:59.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:57.872591+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:57.876591+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:58.265775+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:59.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.851646+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:05:59.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.852103+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:05:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:57.872591+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.267 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:57.876591+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:58.265775+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.851646+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:05:59.268 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:58 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.852103+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:05:59.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:58 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:57.872591+0000 mon.a (mon.0) 426 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:58 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:57.876591+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:05:59.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:58 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:58.265775+0000 mgr.y (mgr.14146) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:05:59.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:58 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.851646+0000 mon.b (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:05:59.333 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:58 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.852103+0000 mon.a (mon.0) 428 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-11-29T17:06:00.271 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.891754+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-11-29T17:06:00.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:58.891845+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-11-29T17:06:00.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.892005+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:00.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.892386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:00.272 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:58.892700+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:00.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.891754+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-11-29T17:06:00.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:58.891845+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-11-29T17:06:00.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.892005+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:00.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.892386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:00.274 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:05:59 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:58.892700+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:00.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.891754+0000 mon.a (mon.0) 429 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-11-29T17:06:00.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:58.891845+0000 mon.a (mon.0) 430 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-11-29T17:06:00.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.892005+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:00.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.892386+0000 mon.b (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:00.332 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:05:59 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:58.892700+0000 mon.a (mon.0) 432 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:01.221 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:59.893630+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:01.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:59.893710+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-11-29T17:06:01.222 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:59.894148+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:05:59.897688+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.223 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:00.237588+0000 mon.a (mon.0) 437 : cluster [INF] osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766] boot 2022-11-29T17:06:01.224 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:00.237631+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-11-29T17:06:01.224 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:00.238162+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.225 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:00 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:00.266154+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:06:01.265 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:59.893630+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:01.266 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:59.893710+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-11-29T17:06:01.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:59.894148+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.267 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:05:59.897688+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:00.237588+0000 mon.a (mon.0) 437 : cluster [INF] osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766] boot 2022-11-29T17:06:01.268 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:00.237631+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-11-29T17:06:01.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:00.238162+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.269 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:00.266154+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:06:01.270 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:59.893630+0000 mon.a (mon.0) 433 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:01.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:59.893710+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-11-29T17:06:01.271 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:59.894148+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:05:59.897688+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:00.237588+0000 mon.a (mon.0) 437 : cluster [INF] osd.5 [v2:172.21.15.191:6808/2858493766,v1:172.21.15.191:6809/2858493766] boot 2022-11-29T17:06:01.272 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:00.237631+0000 mon.a (mon.0) 438 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-11-29T17:06:01.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:00.238162+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-11-29T17:06:01.273 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:00 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:00.266154+0000 mgr.y (mgr.14146) 158 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-11-29T17:06:01.489 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 5 on host 'smithi191' 2022-11-29T17:06:01.969 DEBUG:teuthology.orchestra.run.smithi191:osd.5> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.5.service 2022-11-29T17:06:01.972 INFO:tasks.cephadm:Deploying osd.6 on smithi191 with /dev/nvme2n1... 2022-11-29T17:06:01.973 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme2n1 2022-11-29T17:06:02.005 INFO:journalctl@ceph.osd.5.smithi191.stdout:-- Logs begin at Tue 2022-11-29 16:52:25 UTC. -- 2022-11-29T17:06:02.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:59.865256+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:02.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:05:59.865358+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:02.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:01.236052+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-11-29T17:06:02.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:01.487454+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:02.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:01.501191+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:02.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:01.502374+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:02.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:01.503153+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:02.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:59.865256+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:02.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:05:59.865358+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:02.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:01.236052+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-11-29T17:06:02.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:01.487454+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:02.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:01.501191+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:02.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:01.502374+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:02.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:02 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:01.503153+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:02.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:59.865256+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:02.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:05:59.865358+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:02.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:01.236052+0000 mon.a (mon.0) 440 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-11-29T17:06:02.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:01.487454+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:02.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:01.501191+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:02.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:01.502374+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:02.583 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:02 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:01.503153+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:03.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:02.238136+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-11-29T17:06:03.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:02.266553+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v145: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:03.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:02.238136+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-11-29T17:06:03.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:03 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:02.266553+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v145: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:03.539 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:02.238136+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-11-29T17:06:03.540 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:03 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:02.266553+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v145: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:04.332 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/nvme2n1 2022-11-29T17:06:04.332 INFO:teuthology.orchestra.run.smithi191.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:06:04.332 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme2n1 bs=1M count=10 conv=fsync 2022-11-29T17:06:04.333 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2022-11-29T17:06:04.333 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2022-11-29T17:06:04.333 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0142568 s, 735 MB/s 2022-11-29T17:06:04.333 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2022-11-29T17:06:04.874 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi191:/dev/nvme2n1 2022-11-29T17:06:05.371 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:05 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:04.266926+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v146: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:05.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:04.266926+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v146: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:05.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:05 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:04.266926+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v146: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:06.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:05.426594+0000 mgr.y (mgr.14146) 161 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:06.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:05.431657+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:05.432752+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:05.433752+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:05.434474+0000 mgr.y (mgr.14146) 162 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 8584M 2022-11-29T17:06:06.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:05.440690+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:05.447559+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:05.426594+0000 mgr.y (mgr.14146) 161 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:06.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:05.431657+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:05.432752+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:05.433752+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:05.434474+0000 mgr.y (mgr.14146) 162 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 8584M 2022-11-29T17:06:06.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:05.440690+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:06 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:05.447559+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:05.426594+0000 mgr.y (mgr.14146) 161 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:06.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:05.431657+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:05.432752+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:05.433752+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:06.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:05.434474+0000 mgr.y (mgr.14146) 162 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 8584M 2022-11-29T17:06:06.834 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:05.440690+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:06.834 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:06 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:05.447559+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:07.570 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:06.267381+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:07.570 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:06.508297+0000 mgr.y (mgr.14146) 164 : audit [DBG] from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:07.571 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:06.510692+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:07.571 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:06.513148+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:07.571 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:07 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:06.513918+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:07.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:06.267381+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:07.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:06.508297+0000 mgr.y (mgr.14146) 164 : audit [DBG] from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:07.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:06.510692+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:07.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:06.513148+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:07.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:06.513918+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:07.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:06.267381+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:07.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:06.508297+0000 mgr.y (mgr.14146) 164 : audit [DBG] from='client.24259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme2n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:07.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:06.510692+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:07.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:06.513148+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:07.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:07 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:06.513918+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:08.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.367009+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:06:08.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.367301+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:06:08.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.367009+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:06:08.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:08 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.367301+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:06:08.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.367009+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2022-11-29T17:06:08.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:08 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.367301+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2022-11-29T17:06:09.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:08.267758+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:09.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.773783+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.191:0/2790902057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.774419+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.787195+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]': finished 2022-11-29T17:06:09.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:08.787288+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2022-11-29T17:06:09.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:08.787488+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:09.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:08.267758+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:09.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.773783+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.191:0/2790902057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.774419+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.787195+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]': finished 2022-11-29T17:06:09.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:08.787288+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2022-11-29T17:06:09.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:09 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:08.787488+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:08.267758+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.773783+0000 mon.b (mon.1) 15 : audit [INF] from='client.? 172.21.15.191:0/2790902057' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.774419+0000 mon.a (mon.0) 456 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]: dispatch 2022-11-29T17:06:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.787195+0000 mon.a (mon.0) 457 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9551728d-4077-47f8-9ff2-7f2a2e5ac741"}]': finished 2022-11-29T17:06:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:08.787288+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2022-11-29T17:06:09.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:09 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:08.787488+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:10.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:10.014764+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.191:0/2609437861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:10.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:10 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:10.014764+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.191:0/2609437861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:10.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:10 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:10.014764+0000 mon.b (mon.1) 16 : audit [DBG] from='client.? 172.21.15.191:0/2609437861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:11.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:10.268135+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:11.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:11 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:10.268135+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:11.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:11 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:10.268135+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:13.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:12.268559+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:13.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:13 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:12.268559+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:13.819 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:13 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:12.268559+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:15.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:14.268953+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:15.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:15.255501+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-11-29T17:06:15.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:15.256411+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:15.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:14.268953+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:15.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:15.255501+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-11-29T17:06:15.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:15 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:15.256411+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:15.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:14.268953+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:15.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:15.255501+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-11-29T17:06:15.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:15 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:15.256411+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:16.730 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:16 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:15.257113+0000 mgr.y (mgr.14146) 169 : cephadm [INF] Deploying daemon osd.6 on smithi191 2022-11-29T17:06:16.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:16 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:15.257113+0000 mgr.y (mgr.14146) 169 : cephadm [INF] Deploying daemon osd.6 on smithi191 2022-11-29T17:06:16.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:16 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:15.257113+0000 mgr.y (mgr.14146) 169 : cephadm [INF] Deploying daemon osd.6 on smithi191 2022-11-29T17:06:17.715 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:17 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:16.269466+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:17.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:16.269466+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:17.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:17 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:16.269466+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:19.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:18.269850+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:19.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:19 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:18.269850+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:19.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:19 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:18.269850+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:21.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:20.270190+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:21.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:21 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:20.270190+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:21.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:21 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:20.270190+0000 mgr.y (mgr.14146) 172 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:23.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:23 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:22.270685+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:23.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:22.270685+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:23.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:23 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:22.270685+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:25.317 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:24.073119+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:25.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:24.107937+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:25.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:24.109154+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:25.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:24.109922+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:25.318 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:25 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:24.271132+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:25.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:24.073119+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:25.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:24.107937+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:25.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:24.109154+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:25.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:24.109922+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:25.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:24.271132+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:25.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:24.073119+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:25.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:24.107937+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:25.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:24.109154+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:25.517 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:24.109922+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:25.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:25 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:24.271132+0000 mgr.y (mgr.14146) 174 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:27.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:26.220560+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:26.271512+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:27.516 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:26.638636+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.182130+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:27.517 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.182518+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:27.518 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:26.220560+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:26.271512+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:27.519 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:26.638636+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.182130+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:27.520 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:27 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.182518+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:27.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:26.220560+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:26.271512+0000 mgr.y (mgr.14146) 175 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:27.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:26.638636+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:27.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.182130+0000 mon.b (mon.1) 17 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:27.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:27 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.182518+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-11-29T17:06:29.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.640597+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-11-29T17:06:29.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:27.640705+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2022-11-29T17:06:29.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.640884+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:29.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.641455+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:29.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:27.641743+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:29.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.640597+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-11-29T17:06:29.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:27.640705+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2022-11-29T17:06:29.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.640884+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:29.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.641455+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:29.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:28 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:27.641743+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:29.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:28 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.640597+0000 mon.a (mon.0) 469 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-11-29T17:06:29.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:28 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:27.640705+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2022-11-29T17:06:29.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:28 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.640884+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:29.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:28 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.641455+0000 mon.b (mon.1) 18 : audit [INF] from='osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:29.082 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:28 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:27.641743+0000 mon.a (mon.0) 472 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]: dispatch 2022-11-29T17:06:30.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:28.271891+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:30.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:28.643436+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:30.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:28.643570+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2022-11-29T17:06:30.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:28.644053+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:28.648198+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:29.644566+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326] boot 2022-11-29T17:06:30.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:29.644614+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2022-11-29T17:06:30.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:29.644829+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:28.271891+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:30.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:28.643436+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:30.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:28.643570+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2022-11-29T17:06:30.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:28.644053+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:28.648198+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:29.644566+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326] boot 2022-11-29T17:06:30.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:29.644614+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2022-11-29T17:06:30.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:29 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:29.644829+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:28.271891+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-11-29T17:06:30.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:28.643436+0000 mon.a (mon.0) 473 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi191", "root=default"]}]': finished 2022-11-29T17:06:30.080 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:28.643570+0000 mon.a (mon.0) 474 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2022-11-29T17:06:30.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:28.644053+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:28.648198+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:29.644566+0000 mon.a (mon.0) 477 : cluster [INF] osd.6 [v2:172.21.15.191:6816/2447913326,v1:172.21.15.191:6817/2447913326] boot 2022-11-29T17:06:30.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:29.644614+0000 mon.a (mon.0) 478 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2022-11-29T17:06:30.081 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:29 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:29.644829+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-11-29T17:06:30.557 INFO:teuthology.orchestra.run.smithi191.stdout:Created osd(s) 6 on host 'smithi191' 2022-11-29T17:06:30.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:28.133250+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:30.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:28.133351+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:30.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:30.240249+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2022-11-29T17:06:30.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:30.554068+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:30.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:30.563673+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:30.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:30.564863+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:30.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:30 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:30.565668+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:30.959 DEBUG:teuthology.orchestra.run.smithi191:osd.6> sudo journalctl -f -n 0 -u ceph-63fec4cc-7007-11ed-843b-001a4aab830c@osd.6.service 2022-11-29T17:06:30.963 INFO:tasks.cephadm:Deploying osd.7 on smithi191 with /dev/nvme1n1... 2022-11-29T17:06:30.964 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph-volume lvm zap /dev/nvme1n1 2022-11-29T17:06:30.994 INFO:journalctl@ceph.osd.6.smithi191.stdout:-- Logs begin at Tue 2022-11-29 16:52:25 UTC. -- 2022-11-29T17:06:31.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:28.133250+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:31.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:28.133351+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:31.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:30.240249+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2022-11-29T17:06:31.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:30.554068+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:31.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:30.563673+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:31.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:30.564863+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:31.017 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:30.565668+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:31.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:28.133250+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2022-11-29T17:06:31.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:28.133351+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2022-11-29T17:06:31.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:30.240249+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2022-11-29T17:06:31.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:30.554068+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:31.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:30.563673+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:31.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:30.564863+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:31.019 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:30 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:30.565668+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:31.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:30.272314+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:31.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:31 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:31.254193+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2022-11-29T17:06:32.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:30.272314+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:32.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:31.254193+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2022-11-29T17:06:32.016 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:30.272314+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:32.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:31 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:31.254193+0000 mon.a (mon.0) 485 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2022-11-29T17:06:33.370 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping: /dev/nvme1n1 2022-11-29T17:06:33.370 INFO:teuthology.orchestra.run.smithi191.stderr:--> --destroy was not specified, but zapping a whole device will remove the partition table 2022-11-29T17:06:33.371 INFO:teuthology.orchestra.run.smithi191.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/nvme1n1 bs=1M count=10 conv=fsync 2022-11-29T17:06:33.371 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10+0 records in 2022-11-29T17:06:33.371 INFO:teuthology.orchestra.run.smithi191.stderr:10+0 records out 2022-11-29T17:06:33.371 INFO:teuthology.orchestra.run.smithi191.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0142561 s, 736 MB/s 2022-11-29T17:06:33.372 INFO:teuthology.orchestra.run.smithi191.stderr:--> Zapping successful for: 2022-11-29T17:06:33.902 DEBUG:teuthology.orchestra.run.smithi191:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8dc57b5624d909c1714a82ba84ff24e49431ea76 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 63fec4cc-7007-11ed-843b-001a4aab830c -- ceph orch daemon add osd smithi191:/dev/nvme1n1 2022-11-29T17:06:33.929 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:33 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:32.272751+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:34.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:32.272751+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:34.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:33 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:32.272751+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:35.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:34.273104+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:35.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:34.455824+0000 mgr.y (mgr.14146) 180 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:35.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.461380+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.462537+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.581 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.463398+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.464220+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:34.464876+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 5722M 2022-11-29T17:06:35.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.469459+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.582 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:35 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:34.474001+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:34.273104+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:35.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:34.455824+0000 mgr.y (mgr.14146) 180 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:35.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.461380+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.462537+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.463398+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.464220+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:34.464876+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 5722M 2022-11-29T17:06:35.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.469459+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:34.474001+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:34.273104+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:35.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:34.455824+0000 mgr.y (mgr.14146) 180 : cephadm [INF] Detected new or changed devices on smithi191 2022-11-29T17:06:35.769 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.461380+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.462537+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.463398+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.464220+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2022-11-29T17:06:35.770 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:34.464876+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Adjusting osd_memory_target on smithi191 to 5722M 2022-11-29T17:06:35.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.469459+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:35.771 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:35 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:34.474001+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:36.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:35.699770+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:36.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:35.702070+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:36.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:35.704483+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:36.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:35.705322+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:36.768 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:35.699770+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:36.769 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:35.702070+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:36.769 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:35.704483+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:36.770 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:36 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:35.705322+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:36.770 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:35.699770+0000 mgr.y (mgr.14146) 182 : audit [DBG] from='client.24286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi191:/dev/nvme1n1", "target": ["mon-mgr", ""]}]: dispatch 2022-11-29T17:06:36.771 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:35.702070+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-11-29T17:06:36.771 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:35.704483+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-11-29T17:06:36.772 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:36 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:35.705322+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:37.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:36.273422+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:37.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:37 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:36.273422+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:37.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:37 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:36.273422+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:38.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:37.975446+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.191:0/44184497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:37.975950+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:37.980410+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]': finished 2022-11-29T17:06:38.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:37.980499+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2022-11-29T17:06:38.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:37.980648+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-11-29T17:06:38.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:37.975446+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.191:0/44184497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:37.975950+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:37.980410+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]': finished 2022-11-29T17:06:38.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:37.980499+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2022-11-29T17:06:38.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:38 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:37.980648+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-11-29T17:06:38.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:37.975446+0000 mon.b (mon.1) 19 : audit [INF] from='client.? 172.21.15.191:0/44184497' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:37.975950+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]: dispatch 2022-11-29T17:06:38.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:37.980410+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d71725cc-73c7-4fe5-9d3c-78c65addd602"}]': finished 2022-11-29T17:06:38.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:37.980499+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2022-11-29T17:06:38.833 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:38 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:37.980648+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-11-29T17:06:39.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:38.273724+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:39.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:39.292863+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.191:0/1117294303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:39.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:38.273724+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:39.767 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:39 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:39.292863+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.191:0/1117294303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:39.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:38.273724+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:39.832 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:39 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:39.292863+0000 mon.b (mon.1) 20 : audit [DBG] from='client.? 172.21.15.191:0/1117294303' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-11-29T17:06:41.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:40.274143+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:41.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:41 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:40.274143+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:41.557 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:41 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:40.274143+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:43.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:43 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:42.274542+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:43.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:42.274542+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:43.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:43 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:42.274542+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:45.613 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:44.274966+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:45.613 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:44.441828+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-11-29T17:06:45.613 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:44.442743+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:45.614 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:45 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cephadm 2022-11-29T17:06:44.443444+0000 mgr.y (mgr.14146) 188 : cephadm [INF] Deploying daemon osd.7 on smithi191 2022-11-29T17:06:45.766 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:44.274966+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:45.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:44.441828+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-11-29T17:06:45.767 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:44.442743+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:45.768 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cephadm 2022-11-29T17:06:44.443444+0000 mgr.y (mgr.14146) 188 : cephadm [INF] Deploying daemon osd.7 on smithi191 2022-11-29T17:06:45.768 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:44.274966+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:45.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:44.441828+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-11-29T17:06:45.769 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:44.442743+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:45.770 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:45 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cephadm 2022-11-29T17:06:44.443444+0000 mgr.y (mgr.14146) 188 : cephadm [INF] Deploying daemon osd.7 on smithi191 2022-11-29T17:06:47.765 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:46.275402+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:47.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:47 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:46.275402+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:47.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:47 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:46.275402+0000 mgr.y (mgr.14146) 189 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:49.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:48.275824+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:49.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:49 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:48.275824+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:49.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:49 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:48.275824+0000 mgr.y (mgr.14146) 190 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:51.515 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:50.276343+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:51.516 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:51 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:50.276343+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:51.580 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:51 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:50.276343+0000 mgr.y (mgr.14146) 191 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:53.521 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:53 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:52.276773+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:53.765 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:52.276773+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:53.766 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:53 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:52.276773+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:54.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:53.564325+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:54.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:53.584852+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:54.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:53.586072+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:54.831 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:54 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:53.586780+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:55.015 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:53.564325+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:55.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:53.584852+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:55.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:53.586072+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:55.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: audit 2022-11-29T17:06:53.586780+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:55.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:53.564325+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:55.017 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:53.584852+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-11-29T17:06:55.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:53.586072+0000 mon.a (mon.0) 503 : audit [DBG] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-11-29T17:06:55.018 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:54 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: audit 2022-11-29T17:06:53.586780+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-11-29T17:06:55.830 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:55 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: cluster 2022-11-29T17:06:54.277154+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:56.015 INFO:journalctl@ceph.mon.c.smithi182.stdout:Nov 29 17:06:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-c[110390]: cluster 2022-11-29T17:06:54.277154+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:56.016 INFO:journalctl@ceph.mon.a.smithi182.stdout:Nov 29 17:06:55 smithi182 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-a[100950]: cluster 2022-11-29T17:06:54.277154+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-11-29T17:06:57.330 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:56.024043+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:57.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:57 smithi191 ceph-63fec4cc-7007-11ed-843b-001a4aab830c-mon-b[103271]: audit 2022-11-29T17:06:56.032216+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.182:0/1780548909' entity='mgr.y' 2022-11-29T17:06:57.331 INFO:journalctl@ceph.mon.b.smithi191.stdout:Nov 29 17:06:57 smit