2023-12-07T16:47:33.638 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-07T16:47:33.638 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi --description rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} --archive /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167 -- /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167/orig.config.yaml 2023-12-07T16:47:33.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T16:47:33.745 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167 branch: wip-yuri8-testing-2023-12-06-1425 description: rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} email: null first_in_suite: false job_id: '7482167' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri8-testing-2023-12-06-1425 ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 kernel: hwe: true workunit: branch: wip-yuri8-testing-2023-12-06-1425 sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 seed: 4465 sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri8-testing-2023-12-06-1425 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e068ebcf7ecc6503f24666fb6b152034d3fe1067/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 targets: smithi172.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - cephadm: roleless: true single_host_defaults: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.apply: specs: - placement: count_per_host: 4 host_pattern: '*' service_id: foo service_type: rgw spec: rgw_frontend_port: 8000 - cephadm.wait_for_service: service: rgw.foo - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-07_16:37:24 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-07T16:47:33.745 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e068ebcf7ecc6503f24666fb6b152034d3fe1067/qa; will attempt to use it 2023-12-07T16:47:33.746 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e068ebcf7ecc6503f24666fb6b152034d3fe1067/qa/tasks 2023-12-07T16:47:33.746 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-07T16:47:33.747 INFO:teuthology.task.internal:Checking packages... 2023-12-07T16:47:33.772 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e068ebcf7ecc6503f24666fb6b152034d3fe1067' 2023-12-07T16:47:33.773 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-07T16:47:33.773 INFO:teuthology.packaging:ref: None 2023-12-07T16:47:33.773 INFO:teuthology.packaging:tag: None 2023-12-07T16:47:33.773 INFO:teuthology.packaging:branch: wip-yuri8-testing-2023-12-06-1425 2023-12-07T16:47:33.773 INFO:teuthology.packaging:sha1: e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T16:47:33.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri8-testing-2023-12-06-1425 2023-12-07T16:47:34.056 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-64-ge068ebcf-1focal 2023-12-07T16:47:34.056 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-07T16:47:34.063 INFO:teuthology.task.internal:no buildpackages task found 2023-12-07T16:47:34.063 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-07T16:47:34.083 INFO:teuthology.task.internal:Saving configuration 2023-12-07T16:47:34.093 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-07T16:47:34.098 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T16:47:34.122 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 16:39:22.422126', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-07T16:47:34.122 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-07T16:47:34.128 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-07T16:47:34.128 INFO:teuthology.run_tasks:Running task console_log... 2023-12-07T16:47:34.167 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7bc7328af0>, signals=[15]) 2023-12-07T16:47:34.167 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-07T16:47:34.173 INFO:teuthology.task.internal:Opening connections... 2023-12-07T16:47:34.173 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi172.front.sepia.ceph.com 2023-12-07T16:47:34.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T16:47:34.224 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-07T16:47:34.231 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-12-07T16:47:34.352 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-12-07T16:47:34.353 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-12-07T16:47:34.359 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="Ubuntu" 2023-12-07T16:47:34.359 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-07T16:47:34.359 INFO:teuthology.orchestra.run.smithi172.stdout:ID=ubuntu 2023-12-07T16:47:34.359 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE=debian 2023-12-07T16:47:34.359 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="20.04" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_CODENAME=focal 2023-12-07T16:47:34.360 INFO:teuthology.orchestra.run.smithi172.stdout:UBUNTU_CODENAME=focal 2023-12-07T16:47:34.361 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-12-07T16:47:34.382 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-07T16:47:34.390 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-07T16:47:34.397 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-07T16:47:34.398 DEBUG:teuthology.orchestra.run.smithi172:> test '!' -e /home/ubuntu/cephtest 2023-12-07T16:47:34.412 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-07T16:47:34.418 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-07T16:47:34.418 DEBUG:teuthology.orchestra.run.smithi172:> test -z $(ls -A /var/lib/ceph) 2023-12-07T16:47:34.434 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-07T16:47:34.467 INFO:teuthology.run_tasks:Running task kernel... 2023-12-07T16:47:34.481 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-07T16:47:34.482 INFO:teuthology.task.kernel:normalize config orig: {'hwe': True} 2023-12-07T16:47:34.482 DEBUG:teuthology.task.kernel:normalized overrides {'host.a': {'hwe': True}, 'osd.0': {'hwe': True}, 'osd.1': {'hwe': True}, 'osd.2': {'hwe': True}, 'osd.3': {'hwe': True}, 'client.0': {'hwe': True}} 2023-12-07T16:47:34.482 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro', 'hwe': True}}, timeout 300 2023-12-07T16:47:34.485 DEBUG:teuthology.orchestra.run.smithi172:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-07T16:47:34.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T16:47:34.491 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-12-07T16:47:34.541 INFO:teuthology.orchestra.run.smithi172.stdout:5.4.0-124-generic 2023-12-07T16:47:34.541 INFO:teuthology.task.kernel:Running kernel on smithi172: 5.4.0-124-generic 2023-12-07T16:47:34.541 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2023-12-07T16:47:34.631 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-12-07T16:47:34.804 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-12-07T16:47:34.915 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-07T16:47:34.997 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-12-07T16:47:35.158 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,604 kB] 2023-12-07T16:47:35.342 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-12-07T16:47:35.488 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [913 kB] 2023-12-07T16:47:35.839 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,994 kB] 2023-12-07T16:47:35.922 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [680 kB] 2023-12-07T16:47:36.017 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [484 kB] 2023-12-07T16:47:36.030 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2023-12-07T16:47:36.031 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [36.0 kB] 2023-12-07T16:47:36.031 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,528 kB] 2023-12-07T16:47:36.065 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [402 kB] 2023-12-07T16:47:36.102 INFO:teuthology.orchestra.run.smithi172.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [353 kB] 2023-12-07T16:47:36.107 INFO:teuthology.orchestra.run.smithi172.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2023-12-07T16:47:36.148 INFO:teuthology.orchestra.run.smithi172.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-12-07T16:47:36.152 INFO:teuthology.orchestra.run.smithi172.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,411 kB] 2023-12-07T16:47:36.272 INFO:teuthology.orchestra.run.smithi172.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [761 kB] 2023-12-07T16:47:36.623 INFO:teuthology.orchestra.run.smithi172.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [34.7 kB] 2023-12-07T16:47:36.628 INFO:teuthology.orchestra.run.smithi172.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [336 kB] 2023-12-07T16:47:36.696 INFO:teuthology.orchestra.run.smithi172.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2023-12-07T16:47:36.696 INFO:teuthology.orchestra.run.smithi172.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [914 kB] 2023-12-07T16:47:36.852 INFO:teuthology.orchestra.run.smithi172.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [633 kB] 2023-12-07T16:47:36.866 INFO:teuthology.orchestra.run.smithi172.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,139 kB] 2023-12-07T16:47:36.936 INFO:teuthology.orchestra.run.smithi172.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [192 kB] 2023-12-07T16:47:36.963 INFO:teuthology.orchestra.run.smithi172.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2023-12-07T16:47:36.965 INFO:teuthology.orchestra.run.smithi172.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,188 B] 2023-12-07T16:47:36.967 INFO:teuthology.orchestra.run.smithi172.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-12-07T16:47:36.973 INFO:teuthology.orchestra.run.smithi172.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-12-07T16:47:36.973 INFO:teuthology.orchestra.run.smithi172.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-12-07T16:47:36.975 INFO:teuthology.orchestra.run.smithi172.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [273 kB] 2023-12-07T16:47:36.996 INFO:teuthology.orchestra.run.smithi172.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2023-12-07T16:47:36.998 INFO:teuthology.orchestra.run.smithi172.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2023-12-07T16:47:36.998 INFO:teuthology.orchestra.run.smithi172.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-12-07T16:47:37.000 INFO:teuthology.orchestra.run.smithi172.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-12-07T16:47:37.001 INFO:teuthology.orchestra.run.smithi172.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-12-07T16:47:37.001 INFO:teuthology.orchestra.run.smithi172.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-12-07T16:47:37.003 INFO:teuthology.orchestra.run.smithi172.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-12-07T16:47:37.006 INFO:teuthology.orchestra.run.smithi172.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-12-07T16:47:37.171 INFO:teuthology.orchestra.run.smithi172.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-12-07T16:47:37.357 INFO:teuthology.orchestra.run.smithi172.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-12-07T16:47:37.380 INFO:teuthology.orchestra.run.smithi172.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-12-07T16:47:39.925 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 18.3 MB in 3s (5,777 kB/s) 2023-12-07T16:47:41.285 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-12-07T16:47:41.310 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-12-07T16:47:41.380 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-12-07T16:47:41.582 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-12-07T16:47:41.583 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-12-07T16:47:41.756 INFO:teuthology.orchestra.run.smithi172.stdout:The following additional packages will be installed: 2023-12-07T16:47:41.756 INFO:teuthology.orchestra.run.smithi172.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-12-07T16:47:41.756 INFO:teuthology.orchestra.run.smithi172.stdout: libusbmuxd6 linux-image-5.15.0-89-generic linux-modules-5.15.0-89-generic 2023-12-07T16:47:41.756 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-extra-5.15.0-89-generic thermald upower usbmuxd 2023-12-07T16:47:41.757 INFO:teuthology.orchestra.run.smithi172.stdout:Suggested packages: 2023-12-07T16:47:41.757 INFO:teuthology.orchestra.run.smithi172.stdout: libusbmuxd-tools fdutils linux-doc | linux-hwe-5.15-source-5.15.0 2023-12-07T16:47:41.757 INFO:teuthology.orchestra.run.smithi172.stdout: linux-hwe-5.15-tools linux-headers-5.15.0-89-generic 2023-12-07T16:47:41.812 INFO:teuthology.orchestra.run.smithi172.stdout:The following NEW packages will be installed: 2023-12-07T16:47:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: libdbus-glib-1-2 libevdev2 libimobiledevice6 libplist3 libupower-glib3 2023-12-07T16:47:41.812 INFO:teuthology.orchestra.run.smithi172.stdout: libusbmuxd6 linux-image-5.15.0-89-generic linux-image-generic-hwe-20.04 2023-12-07T16:47:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: linux-modules-5.15.0-89-generic linux-modules-extra-5.15.0-89-generic 2023-12-07T16:47:41.813 INFO:teuthology.orchestra.run.smithi172.stdout: thermald upower usbmuxd 2023-12-07T16:47:41.998 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 13 newly installed, 0 to remove and 283 not upgraded. 2023-12-07T16:47:41.998 INFO:teuthology.orchestra.run.smithi172.stdout:Need to get 90.8 MB of archives. 2023-12-07T16:47:41.998 INFO:teuthology.orchestra.run.smithi172.stdout:After this operation, 497 MB of additional disk space will be used. 2023-12-07T16:47:41.998 INFO:teuthology.orchestra.run.smithi172.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 libdbus-glib-1-2 amd64 0.110-5fakssync1 [59.1 kB] 2023-12-07T16:47:42.281 INFO:teuthology.orchestra.run.smithi172.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 libplist3 amd64 2.1.0-4build2 [31.6 kB] 2023-12-07T16:47:42.309 INFO:teuthology.orchestra.run.smithi172.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 libusbmuxd6 amd64 2.0.1-2 [19.1 kB] 2023-12-07T16:47:42.328 INFO:teuthology.orchestra.run.smithi172.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 libimobiledevice6 amd64 1.2.1~git20191129.9f79242-1build1 [65.2 kB] 2023-12-07T16:47:42.399 INFO:teuthology.orchestra.run.smithi172.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libupower-glib3 amd64 0.99.11-1build2 [43.2 kB] 2023-12-07T16:47:42.436 INFO:teuthology.orchestra.run.smithi172.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.15.0-89-generic amd64 5.15.0-89.99~20.04.1 [20.9 MB] 2023-12-07T16:47:43.282 INFO:teuthology.orchestra.run.smithi172.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.15.0-89-generic amd64 5.15.0-89.99~20.04.1 [11.4 MB] 2023-12-07T16:47:43.590 INFO:teuthology.orchestra.run.smithi172.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.15.0-89-generic amd64 5.15.0-89.99~20.04.1 [58.0 MB] 2023-12-07T16:47:45.503 INFO:teuthology.orchestra.run.smithi172.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic-hwe-20.04 amd64 5.15.0.89.99~20.04.47 [2,628 B] 2023-12-07T16:47:45.503 INFO:teuthology.orchestra.run.smithi172.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libevdev2 amd64 1.9.0+dfsg-1ubuntu0.2 [31.6 kB] 2023-12-07T16:47:45.503 INFO:teuthology.orchestra.run.smithi172.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 thermald amd64 1.9.1-1ubuntu0.6 [233 kB] 2023-12-07T16:47:45.671 INFO:teuthology.orchestra.run.smithi172.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 upower amd64 0.99.11-1build2 [104 kB] 2023-12-07T16:47:46.015 INFO:teuthology.orchestra.run.smithi172.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 usbmuxd amd64 1.1.1~git20191130.9af2b12-1 [38.4 kB] 2023-12-07T16:47:46.701 INFO:teuthology.orchestra.run.smithi172.stdout:Fetched 90.8 MB in 4s (21.5 MB/s) 2023-12-07T16:47:46.975 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libdbus-glib-1-2:amd64. 2023-12-07T16:47:48.724 INFO:teuthology.orchestra.run.smithi172.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-12-07T16:47:48.728 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../00-libdbus-glib-1-2_0.110-5fakssync1_amd64.deb ... 2023-12-07T16:47:48.864 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-12-07T16:47:49.201 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libplist3:amd64. 2023-12-07T16:47:49.217 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../01-libplist3_2.1.0-4build2_amd64.deb ... 2023-12-07T16:47:49.251 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libplist3:amd64 (2.1.0-4build2) ... 2023-12-07T16:47:49.570 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libusbmuxd6:amd64. 2023-12-07T16:47:49.584 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../02-libusbmuxd6_2.0.1-2_amd64.deb ... 2023-12-07T16:47:49.629 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libusbmuxd6:amd64 (2.0.1-2) ... 2023-12-07T16:47:49.973 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libimobiledevice6:amd64. 2023-12-07T16:47:49.987 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../03-libimobiledevice6_1.2.1~git20191129.9f79242-1build1_amd64.deb ... 2023-12-07T16:47:50.031 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-12-07T16:47:50.351 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libupower-glib3:amd64. 2023-12-07T16:47:50.367 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../04-libupower-glib3_0.99.11-1build2_amd64.deb ... 2023-12-07T16:47:50.401 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libupower-glib3:amd64 (0.99.11-1build2) ... 2023-12-07T16:47:50.704 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-5.15.0-89-generic. 2023-12-07T16:47:50.720 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../05-linux-modules-5.15.0-89-generic_5.15.0-89.99~20.04.1_amd64.deb ... 2023-12-07T16:47:50.762 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:47:53.271 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-5.15.0-89-generic. 2023-12-07T16:47:53.285 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../06-linux-image-5.15.0-89-generic_5.15.0-89.99~20.04.1_amd64.deb ... 2023-12-07T16:47:53.389 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:47:53.908 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-89-generic. 2023-12-07T16:47:53.923 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../07-linux-modules-extra-5.15.0-89-generic_5.15.0-89.99~20.04.1_amd64.deb ... 2023-12-07T16:47:53.966 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-modules-extra-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:48:00.884 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package linux-image-generic-hwe-20.04. 2023-12-07T16:48:00.901 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../08-linux-image-generic-hwe-20.04_5.15.0.89.99~20.04.47_amd64.deb ... 2023-12-07T16:48:00.942 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking linux-image-generic-hwe-20.04 (5.15.0.89.99~20.04.47) ... 2023-12-07T16:48:01.278 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package libevdev2:amd64. 2023-12-07T16:48:01.293 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../09-libevdev2_1.9.0+dfsg-1ubuntu0.2_amd64.deb ... 2023-12-07T16:48:01.336 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-12-07T16:48:01.731 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package thermald. 2023-12-07T16:48:01.745 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../10-thermald_1.9.1-1ubuntu0.6_amd64.deb ... 2023-12-07T16:48:01.789 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking thermald (1.9.1-1ubuntu0.6) ... 2023-12-07T16:48:02.394 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package upower. 2023-12-07T16:48:02.409 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../11-upower_0.99.11-1build2_amd64.deb ... 2023-12-07T16:48:02.468 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking upower (0.99.11-1build2) ... 2023-12-07T16:48:02.865 INFO:teuthology.orchestra.run.smithi172.stdout:Selecting previously unselected package usbmuxd. 2023-12-07T16:48:02.878 INFO:teuthology.orchestra.run.smithi172.stdout:Preparing to unpack .../12-usbmuxd_1.1.1~git20191130.9af2b12-1_amd64.deb ... 2023-12-07T16:48:02.923 INFO:teuthology.orchestra.run.smithi172.stdout:Unpacking usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-12-07T16:48:03.227 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libplist3:amd64 (2.1.0-4build2) ... 2023-12-07T16:48:03.362 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libdbus-glib-1-2:amd64 (0.110-5fakssync1) ... 2023-12-07T16:48:03.486 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libusbmuxd6:amd64 (2.0.1-2) ... 2023-12-07T16:48:03.635 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libupower-glib3:amd64 (0.99.11-1build2) ... 2023-12-07T16:48:03.763 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libimobiledevice6:amd64 (1.2.1~git20191129.9f79242-1build1) ... 2023-12-07T16:48:03.889 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up libevdev2:amd64 (1.9.0+dfsg-1ubuntu0.2) ... 2023-12-07T16:48:04.015 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up upower (0.99.11-1build2) ... 2023-12-07T16:48:04.566 INFO:teuthology.orchestra.run.smithi172.stdout:upower.service is a disabled or a static unit, not starting it. 2023-12-07T16:48:04.619 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up usbmuxd (1.1.1~git20191130.9af2b12-1) ... 2023-12-07T16:48:04.798 INFO:teuthology.orchestra.run.smithi172.stdout:Warning: The home dir /var/lib/usbmux you specified can't be accessed: No such file or directory 2023-12-07T16:48:04.803 INFO:teuthology.orchestra.run.smithi172.stdout:Adding system user `usbmux' (UID 114) ... 2023-12-07T16:48:04.803 INFO:teuthology.orchestra.run.smithi172.stdout:Adding new user `usbmux' (UID 114) with group `plugdev' ... 2023-12-07T16:48:05.262 INFO:teuthology.orchestra.run.smithi172.stdout:Not creating home directory `/var/lib/usbmux'. 2023-12-07T16:48:05.489 INFO:teuthology.orchestra.run.smithi172.stdout:usbmuxd.service is a disabled or a static unit, not starting it. 2023-12-07T16:48:05.533 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up thermald (1.9.1-1ubuntu0.6) ... 2023-12-07T16:48:05.869 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.thermald.service -> /lib/systemd/system/thermald.service. 2023-12-07T16:48:05.869 INFO:teuthology.orchestra.run.smithi172.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/thermald.service -> /lib/systemd/system/thermald.service. 2023-12-07T16:48:06.353 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:48:07.759 INFO:teuthology.orchestra.run.smithi172.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-89-generic 2023-12-07T16:48:07.759 INFO:teuthology.orchestra.run.smithi172.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-89-generic 2023-12-07T16:48:08.198 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-extra-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:48:09.598 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-modules-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:48:10.991 INFO:teuthology.orchestra.run.smithi172.stdout:Setting up linux-image-generic-hwe-20.04 (5.15.0.89.99~20.04.47) ... 2023-12-07T16:48:11.134 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-07T16:48:11.414 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-07T16:48:12.192 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-07T16:48:12.292 INFO:teuthology.orchestra.run.smithi172.stdout:Processing triggers for linux-image-5.15.0-89-generic (5.15.0-89.99~20.04.1) ... 2023-12-07T16:48:12.360 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-12-07T16:48:12.361 INFO:teuthology.orchestra.run.smithi172.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-89-generic 2023-12-07T16:48:37.789 INFO:teuthology.orchestra.run.smithi172.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-12-07T16:48:37.789 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub' 2023-12-07T16:48:37.802 INFO:teuthology.orchestra.run.smithi172.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T16:48:37.824 INFO:teuthology.orchestra.run.smithi172.stdout:Generating grub configuration file ... 2023-12-07T16:48:38.141 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-12-07T16:48:38.161 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-12-07T16:48:38.546 INFO:teuthology.orchestra.run.smithi172.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-07T16:48:38.557 INFO:teuthology.orchestra.run.smithi172.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-07T16:48:40.371 INFO:teuthology.orchestra.run.smithi172.stdout:done 2023-12-07T16:48:40.803 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic-hwe-20.04 2023-12-07T16:48:40.848 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic-hwe-20.04 2023-12-07T16:48:40.848 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta-hwe-5.15 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.89.99~20.04.47 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2023-12-07T16:48:40.849 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2023-12-07T16:48:40.850 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.15.0-89-generic 2023-12-07T16:48:40.850 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-07T16:48:40.850 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-07T16:48:40.850 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2023-12-07T16:48:40.850 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi172.front.sepia.ceph.com, path=None, version=distro) 2023-12-07T16:48:40.850 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get clean 2023-12-07T16:48:40.927 DEBUG:teuthology.orchestra.run.smithi172:> sudo apt-get update 2023-12-07T16:48:41.090 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-07T16:48:41.097 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-07T16:48:41.113 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-07T16:48:41.227 INFO:teuthology.orchestra.run.smithi172.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-07T16:48:42.899 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-12-07T16:48:42.924 DEBUG:teuthology.orchestra.run.smithi172:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic-hwe-20.04 2023-12-07T16:48:42.994 INFO:teuthology.orchestra.run.smithi172.stdout:Reading package lists... 2023-12-07T16:48:43.175 INFO:teuthology.orchestra.run.smithi172.stdout:Building dependency tree... 2023-12-07T16:48:43.175 INFO:teuthology.orchestra.run.smithi172.stdout:Reading state information... 2023-12-07T16:48:43.382 INFO:teuthology.orchestra.run.smithi172.stdout:linux-image-generic-hwe-20.04 is already the newest version (5.15.0.89.99~20.04.47). 2023-12-07T16:48:43.382 INFO:teuthology.orchestra.run.smithi172.stdout:0 upgraded, 0 newly installed, 0 to remove and 283 not upgraded. 2023-12-07T16:48:43.384 DEBUG:teuthology.orchestra.run.smithi172:> dpkg -s linux-image-generic-hwe-20.04 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Package: linux-image-generic-hwe-20.04 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Status: install ok installed 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Priority: optional 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Section: kernel 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Installed-Size: 20 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Maintainer: Ubuntu Kernel Team 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Architecture: amd64 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Source: linux-meta-hwe-5.15 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Version: 5.15.0.89.99~20.04.47 2023-12-07T16:48:43.407 INFO:teuthology.orchestra.run.smithi172.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-89), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-12-07T16:48:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Depends: linux-image-5.15.0-89-generic, linux-modules-extra-5.15.0-89-generic, linux-firmware, intel-microcode, amd64-microcode 2023-12-07T16:48:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Recommends: thermald 2023-12-07T16:48:43.408 INFO:teuthology.orchestra.run.smithi172.stdout:Description: Generic Linux kernel image 2023-12-07T16:48:43.408 INFO:teuthology.orchestra.run.smithi172.stdout: This package will always depend on the latest generic kernel image 2023-12-07T16:48:43.408 INFO:teuthology.orchestra.run.smithi172.stdout: available. 2023-12-07T16:48:43.408 DEBUG:teuthology.orchestra.run.smithi172:> mktemp 2023-12-07T16:48:43.414 INFO:teuthology.orchestra.run.smithi172.stdout:/tmp/tmp.z5pU6BrtT3 2023-12-07T16:48:43.414 DEBUG:teuthology.orchestra.run.smithi172:> sudo cp /boot/grub/grub.cfg /tmp/tmp.z5pU6BrtT3 2023-12-07T16:48:43.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0666 /tmp/tmp.z5pU6BrtT3 2023-12-07T16:48:43.467 DEBUG:teuthology.orchestra.remote:smithi172:/tmp/tmp.z5pU6BrtT3 is 9KB 2023-12-07T16:48:43.481 DEBUG:teuthology.orchestra.run.smithi172:> rm -fr /tmp/tmp.z5pU6BrtT3 2023-12-07T16:48:43.488 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-12-07T16:48:43.546 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T16:48:43.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-12-07T16:48:43.546 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-12-07T16:48:43.578 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-89-generic 2023-12-07T16:48:43.578 DEBUG:teuthology.orchestra.run.smithi172:> sudo update-grub 2023-12-07T16:48:44.836 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub' 2023-12-07T16:48:44.841 INFO:teuthology.orchestra.run.smithi172.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-07T16:48:44.851 INFO:teuthology.orchestra.run.smithi172.stderr:Generating grub configuration file ... 2023-12-07T16:48:45.094 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.15.0-89-generic 2023-12-07T16:48:45.106 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.15.0-89-generic 2023-12-07T16:48:45.470 INFO:teuthology.orchestra.run.smithi172.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-07T16:48:45.482 INFO:teuthology.orchestra.run.smithi172.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-07T16:48:46.252 INFO:teuthology.orchestra.run.smithi172.stderr:done 2023-12-07T16:48:46.254 DEBUG:teuthology.orchestra.run.smithi172:> sudo shutdown -r now 2023-12-07T16:49:16.286 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2023-12-07T16:49:16.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T16:49:16.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T16:49:50.947 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-12-07T16:49:59.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T16:49:59.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T16:50:32.146 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-12-07T16:50:33.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T16:50:33.215 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.15.0-89-generic"... 2023-12-07T16:50:33.215 DEBUG:teuthology.orchestra.run.smithi172:> uname -r 2023-12-07T16:50:33.262 INFO:teuthology.orchestra.run.smithi172.stdout:5.15.0-89-generic 2023-12-07T16:50:33.262 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-89-generic vs 5.15.0-89-generic 2023-12-07T16:50:33.262 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-07T16:50:33.263 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-07T16:50:34.264 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2023-12-07T16:50:34.264 DEBUG:teuthology.orchestra.run.smithi172:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-07T16:50:34.441 INFO:teuthology.orchestra.run.smithi172.stdout:ttyS1 2023-12-07T16:50:34.475 DEBUG:teuthology.parallel:result is None 2023-12-07T16:50:34.475 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-07T16:50:34.482 INFO:teuthology.task.internal:Creating test directory... 2023-12-07T16:50:34.482 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-07T16:50:34.489 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-07T16:50:34.496 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-07T16:50:34.504 INFO:teuthology.task.internal:Creating archive directory... 2023-12-07T16:50:34.504 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-07T16:50:34.565 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-07T16:50:34.572 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-07T16:50:34.572 DEBUG:teuthology.orchestra.run.smithi172:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-07T16:50:34.626 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T16:50:34.637 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-07T16:50:34.640 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-07T16:50:34.647 INFO:teuthology.task.internal:Configuring sudo... 2023-12-07T16:50:34.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-07T16:50:34.814 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-07T16:50:34.828 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-07T16:50:34.829 DEBUG:teuthology.orchestra.run.smithi172:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-07T16:50:34.835 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-07T16:50:34.883 DEBUG:teuthology.orchestra.run.smithi172:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-07T16:50:34.930 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T16:50:34.930 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-07T16:50:35.062 DEBUG:teuthology.orchestra.run.smithi172:> sudo service rsyslog restart 2023-12-07T16:50:35.158 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-07T16:50:35.167 INFO:teuthology.task.internal:Starting timer... 2023-12-07T16:50:35.167 INFO:teuthology.run_tasks:Running task pcp... 2023-12-07T16:50:35.180 INFO:teuthology.run_tasks:Running task selinux... 2023-12-07T16:50:35.192 DEBUG:teuthology.task.selinux:Excluding smithi172: OS 'ubuntu' does not support SELinux 2023-12-07T16:50:35.192 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-07T16:50:35.193 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-07T16:50:35.193 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-07T16:50:35.193 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-07T16:50:35.204 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-07T16:50:35.214 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-07T16:50:35.414 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-07T16:50:35.439 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-07T16:50:35.440 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi172.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-07T17:01:42.254 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi172.front.sepia.ceph.com')] 2023-12-07T17:01:42.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T17:01:42.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-07T17:01:42.344 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-12-07T17:01:42.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-12-07T17:01:42.465 INFO:teuthology.run_tasks:Running task clock... 2023-12-07T17:01:42.483 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-07T17:01:42.483 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-07T17:01:42.483 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T17:01:42.539 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-07T17:01:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Command line: ntpd -gq 2023-12-07T17:01:42.540 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: proto: precision = 0.100 usec (-23) 2023-12-07T17:01:42.541 INFO:teuthology.orchestra.run.smithi172.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T17:01:42.541 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-07T17:01:42.541 INFO:teuthology.orchestra.run.smithi172.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-07T17:01:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: restrict ::: KOD does nothing without LIMITED. 2023-12-07T17:01:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen and drop on 0 v6wildcard [::]:123 2023-12-07T17:01:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-07T17:01:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen normally on 2 lo 127.0.0.1:123 2023-12-07T17:01:42.542 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen normally on 3 enp3s0f1 172.21.15.172:123 2023-12-07T17:01:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen normally on 4 lo [::1]:123 2023-12-07T17:01:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f91%5]:123 2023-12-07T17:01:42.543 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:42 ntpd[23437]: Listening on routing socket on fd #22 for interface updates 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:43.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:43.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:43 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:44.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:44.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:44.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:44.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:44.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:44.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:44 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:45.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:45.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:45 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:46.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:46.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:46.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:46.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:46.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:46.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:46 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:47.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:47 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:48.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:48.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:48.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:48.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:48.543 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:48.543 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:48 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:49.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:49.540 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: can't open /var/log/ntpstats/rawstats.20231207: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: can't open /var/log/ntpstats/peerstats.20231207: Permission denied 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stdout: 7 Dec 17:01:49 ntpd[23437]: ntpd: time slew -0.000070 s 2023-12-07T17:01:49.541 INFO:teuthology.orchestra.run.smithi172.stdout:ntpd: time slew -0.000070s 2023-12-07T17:01:49.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-07T17:01:49.542 INFO:teuthology.orchestra.run.smithi172.stderr: 7 Dec 17:01:49 ntpd[23437]: can't open /var/log/ntpstats/loopstats.20231207: Permission denied 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-07T17:01:49.595 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-07T17:01:49.596 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-07T17:01:49.698 INFO:tasks.cephadm:Config: {'roleless': True, 'single_host_defaults': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'e068ebcf7ecc6503f24666fb6b152034d3fe1067'} 2023-12-07T17:01:49.699 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T17:01:49.699 INFO:tasks.cephadm:Cluster fsid is 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:01:49.699 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-07T17:01:49.699 INFO:tasks.cephadm:No mon roles; fabricating mons 2023-12-07T17:01:49.699 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi172': '172.21.15.172'} 2023-12-07T17:01:49.699 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-07T17:01:49.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname $(hostname -s) 2023-12-07T17:01:49.715 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-07T17:01:49.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T17:01:49.853 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e068ebcf7ecc6503f24666fb6b152034d3fe1067', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=focal,DIST=focal,MACHINE_SIZE=gigantic/74753/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-64-ge068ebcf', 'node_name': '172.21.5.38+adami08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=focal,DIST=focal,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-64-ge068ebcf-1focal'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-06-1425/e068ebcf7ecc6503f24666fb6b152034d3fe1067/ubuntu/focal/flavors/default/', 'distro_codename': 'focal', 'modified': '2023-12-07 00:59:41.089290', 'distro_version': '20.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-yuri8-testing-2023-12-06-1425', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-yuri8-testing-2023-12-06-1425/e068ebcf7ecc6503f24666fb6b152034d3fe1067/ubuntu/focal/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2023-12-07T17:01:50.000 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-yuri8-testing-2023-12-06-1425, sha1 e068ebcf7ecc6503f24666fb6b152034d3fe1067 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F20.04%2Fx86_64&flavor=default&sha1=e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T17:01:50.000 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2023-12-06-1425/e068ebcf7ecc6503f24666fb6b152034d3fe1067/ubuntu/focal/x86_64/flavors/default/cephadm 2023-12-07T17:01:50.001 DEBUG:teuthology.orchestra.run.smithi172:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-yuri8-testing-2023-12-06-1425/e068ebcf7ecc6503f24666fb6b152034d3fe1067/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-07T17:01:50.529 INFO:teuthology.orchestra.run.smithi172.stdout:-rw-rw-r-- 1 ubuntu ubuntu 832268 Dec 7 17:01 /home/ubuntu/cephtest/cephadm 2023-12-07T17:01:50.529 DEBUG:teuthology.orchestra.run.smithi172:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-07T17:01:50.549 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 on all hosts... 2023-12-07T17:01:50.549 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 pull 2023-12-07T17:01:50.851 INFO:teuthology.orchestra.run.smithi172.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067... 2023-12-07T17:02:35.730 INFO:teuthology.orchestra.run.smithi172.stdout:{ 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "ceph_version": "ceph version 19.0.0-64-ge068ebcf (e068ebcf7ecc6503f24666fb6b152034d3fe1067) reef (dev)", 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "repo_digests": [ 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6" 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout: ] 2023-12-07T17:02:35.731 INFO:teuthology.orchestra.run.smithi172.stdout:} 2023-12-07T17:02:35.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo mkdir -p /etc/ceph 2023-12-07T17:02:35.775 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 777 /etc/ceph 2023-12-07T17:02:35.832 INFO:tasks.cephadm:Writing seed config... 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-07T17:02:35.833 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-07T17:02:35.834 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-07T17:02:35.834 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:02:35.834 DEBUG:teuthology.orchestra.run.smithi172:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-07T17:02:35.884 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 4fe67048-9522-11ee-95a2-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2023-12-07T17:02:35.884 DEBUG:teuthology.orchestra.run.smithi172:mon.smithi172> sudo journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service 2023-12-07T17:02:35.926 INFO:tasks.cephadm:Bootstrapping... 2023-12-07T17:02:35.926 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 -v bootstrap --fsid 4fe67048-9522-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.172 --single-host-defaults --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-07T17:02:36.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-12-07T17:02:36.138 INFO:teuthology.orchestra.run.smithi172.stdout:-------------------------------------------------------------------------------- 2023-12-07T17:02:36.138 INFO:teuthology.orchestra.run.smithi172.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067', '-v', 'bootstrap', '--fsid', '4fe67048-9522-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.172', '--single-host-defaults', '--skip-admin-label'] 2023-12-07T17:02:36.139 INFO:teuthology.orchestra.run.smithi172.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-07T17:02:36.139 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying podman|docker is present... 2023-12-07T17:02:36.139 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying lvm2 is present... 2023-12-07T17:02:36.139 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying time synchronization is in place... 2023-12-07T17:02:36.146 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-07T17:02:36.147 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-07T17:02:36.154 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-07T17:02:36.154 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.161 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2023-12-07T17:02:36.161 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2023-12-07T17:02:36.167 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2023-12-07T17:02:36.167 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2023-12-07T17:02:36.174 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout masked 2023-12-07T17:02:36.180 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2023-12-07T17:02:36.180 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.186 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2023-12-07T17:02:36.186 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2023-12-07T17:02:36.192 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2023-12-07T17:02:36.192 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.201 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout enabled 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout active 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:Unit ntp.service is enabled and running 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:Repeating the final host check... 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:docker (/usr/bin/docker) is present 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl is present 2023-12-07T17:02:36.207 INFO:teuthology.orchestra.run.smithi172.stdout:lvcreate is present 2023-12-07T17:02:36.214 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-07T17:02:36.214 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-07T17:02:36.220 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-07T17:02:36.220 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.228 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2023-12-07T17:02:36.228 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2023-12-07T17:02:36.234 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2023-12-07T17:02:36.235 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.242 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2023-12-07T17:02:36.243 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout masked 2023-12-07T17:02:36.248 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2023-12-07T17:02:36.248 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.255 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2023-12-07T17:02:36.255 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2023-12-07T17:02:36.261 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2023-12-07T17:02:36.262 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout inactive 2023-12-07T17:02:36.269 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout enabled 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stdout active 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Unit ntp.service is enabled and running 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Host looks OK 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Cluster fsid: 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Acquiring lock 140142847420160 on /run/cephadm/4fe67048-9522-11ee-95a2-87774f69a715.lock 2023-12-07T17:02:36.276 INFO:teuthology.orchestra.run.smithi172.stdout:Lock 140142847420160 acquired on /run/cephadm/4fe67048-9522-11ee-95a2-87774f69a715.lock 2023-12-07T17:02:36.277 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying IP 172.21.15.172 port 3300 ... 2023-12-07T17:02:36.277 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying IP 172.21.15.172 port 6789 ... 2023-12-07T17:02:36.277 INFO:teuthology.orchestra.run.smithi172.stdout:Base mon IP(s) is [172.21.15.172:3300, 172.21.15.172:6789], mon addrv is [v2:172.21.15.172:3300,v1:172.21.15.172:6789] 2023-12-07T17:02:36.283 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2023-12-07T17:02:36.283 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.172 metric 100 2023-12-07T17:02:36.283 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2023-12-07T17:02:36.283 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.172 2023-12-07T17:02:36.283 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.172 metric 100 2023-12-07T17:02:36.286 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-07T17:02:36.286 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2023-12-07T17:02:36.286 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1742sec pref medium 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7f91/64 scope link 2023-12-07T17:02:36.290 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-07T17:02:36.291 INFO:teuthology.orchestra.run.smithi172.stdout:Mon IP `172.21.15.172` is in CIDR network `172.21.0.0/20` 2023-12-07T17:02:36.291 INFO:teuthology.orchestra.run.smithi172.stdout:Mon IP `172.21.15.172` is in CIDR network `172.21.0.0/20` 2023-12-07T17:02:36.291 INFO:teuthology.orchestra.run.smithi172.stdout:Mon IP `172.21.15.172` is in CIDR network `172.21.15.254/32` 2023-12-07T17:02:36.291 INFO:teuthology.orchestra.run.smithi172.stdout:Mon IP `172.21.15.172` is in CIDR network `172.21.15.254/32` 2023-12-07T17:02:36.291 INFO:teuthology.orchestra.run.smithi172.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20', '172.21.15.254/32', '172.21.15.254/32'] 2023-12-07T17:02:36.292 INFO:teuthology.orchestra.run.smithi172.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-07T17:02:36.293 INFO:teuthology.orchestra.run.smithi172.stdout:Adjusting default settings to suit single-host cluster... 2023-12-07T17:02:36.293 INFO:teuthology.orchestra.run.smithi172.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067... 2023-12-07T17:02:36.539 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/docker: stdout e068ebcf7ecc6503f24666fb6b152034d3fe1067: Pulling from ceph-ci/ceph 2023-12-07T17:02:36.539 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/docker: stdout Digest: sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6 2023-12-07T17:02:36.539 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T17:02:36.539 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 2023-12-07T17:02:38.098 INFO:teuthology.orchestra.run.smithi172.stdout:ceph: stdout ceph version 19.0.0-64-ge068ebcf (e068ebcf7ecc6503f24666fb6b152034d3fe1067) reef (dev) 2023-12-07T17:02:38.098 INFO:teuthology.orchestra.run.smithi172.stdout:Ceph version: ceph version 19.0.0-64-ge068ebcf (e068ebcf7ecc6503f24666fb6b152034d3fe1067) reef (dev) 2023-12-07T17:02:38.098 INFO:teuthology.orchestra.run.smithi172.stdout:Extracting ceph user uid/gid from container image... 2023-12-07T17:02:39.577 INFO:teuthology.orchestra.run.smithi172.stdout:stat: stdout 167 167 2023-12-07T17:02:39.577 INFO:teuthology.orchestra.run.smithi172.stdout:Creating initial keys... 2023-12-07T17:02:41.051 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-authtool: stdout AQCw+nFljyUZGhAAD/7LmSZz7HZnc5KN5WX/1g== 2023-12-07T17:02:42.552 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-authtool: stdout AQCx+nFlazALNxAAhfvmvKgdD5xT8lvP2/CROw== 2023-12-07T17:02:43.989 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-authtool: stdout AQCz+nFl60gTFxAAep3pNERUelaYwWu3c/JdDg== 2023-12-07T17:02:43.990 INFO:teuthology.orchestra.run.smithi172.stdout:Creating initial monmap... 2023-12-07T17:02:45.407 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:monmaptool for smithi172 [v2:172.21.15.172:3300,v1:172.21.15.172:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:setting min_mon_release = pacific 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: set fsid to 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:02:45.408 INFO:teuthology.orchestra.run.smithi172.stdout:Creating mon... 2023-12-07T17:02:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.253+0000 7f6473118c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-12-07T17:02:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.253+0000 7f6473118c80 1 imported monmap: 2023-12-07T17:02:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr epoch 0 2023-12-07T17:02:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr fsid 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:46.912 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr last_changed 2023-12-07T17:02:44.868325+0000 2023-12-07T17:02:46.914 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr created 2023-12-07T17:02:44.868325+0000 2023-12-07T17:02:46.914 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr min_mon_release 16 (pacific) 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 0: [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon.smithi172 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 0 /usr/bin/ceph-mon: set fsid to 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: RocksDB version: 7.9.2 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Git sha 0 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Compile date 2023-12-06 23:35:10 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: DB SUMMARY 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: DB Session ID: K2P4JMSXWJWZ3P8ZXHGI 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 0, files: 2023-12-07T17:02:46.915 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.916 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 2023-12-07T17:02:46.916 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.942 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.error_if_exists: 0 2023-12-07T17:02:46.942 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.create_if_missing: 1 2023-12-07T17:02:46.942 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.paranoid_checks: 1 2023-12-07T17:02:46.942 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.env: 0x563c68a92a60 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.fs: PosixFileSystem 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.info_log: 0x563c697c08e0 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-12-07T17:02:46.943 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.statistics: (nil) 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.use_fsync: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_log_file_size: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_fallocate: 1 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.use_direct_reads: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.create_missing_column_families: 0 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.db_log_dir: 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.wal_dir: 2023-12-07T17:02:46.944 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.advise_random_on_open: 1 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.write_buffer_manager: 0x563c69795220 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.rate_limiter: (nil) 2023-12-07T17:02:46.945 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.unordered_write: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.row_cache: None 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.wal_filter: None 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.two_write_queues: 0 2023-12-07T17:02:46.946 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.manual_wal_flush: 0 2023-12-07T17:02:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.wal_compression: 0 2023-12-07T17:02:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.atomic_flush: 0 2023-12-07T17:02:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T17:02:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T17:02:46.947 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.log_readahead_size: 0 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-12-07T17:02:46.948 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_background_jobs: 2 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_background_compactions: -1 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_subcompactions: 1 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_total_wal_size: 0 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_open_files: -1 2023-12-07T17:02:46.949 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bytes_per_sync: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_background_flushes: -1 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Compression algorithms supported: 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kZSTD supported: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kXpressCompression supported: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kZlibCompression supported: 1 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kSnappyCompression supported: 1 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kLZ4Compression supported: 1 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: kBZip2Compression supported: 0 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T17:02:46.950 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000001 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.merge_operator: 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_filter: None 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_filter_factory: None 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T17:02:46.951 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563c697c09e0) 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x563c69817090 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2023-12-07T17:02:46.952 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2023-12-07T17:02:46.953 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression: NoCompression 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-12-07T17:02:46.954 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.num_levels: 7 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T17:02:46.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.level: 32767 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.enabled: false 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T17:02:46.956 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.arena_block_size: 1048576 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T17:02:46.957 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T17:02:46.958 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.table_properties_collectors: 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.inplace_update_support: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.bloom_locality: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.max_successive_merges: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.force_consistency_checks: 1 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-12-07T17:02:46.959 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.ttl: 2592000 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enable_blob_files: false 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.min_blob_size: 0 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_file_size: 268435456 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T17:02:46.960 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.257+0000 7f6473118c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e118732f-368a-4c5a-9a28-25f6e35d3a7a 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2023-12-07T17:02:46.961 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563c6988a000 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: DB pointer 0x563c6987c000 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f64632d1700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f64632d1700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.962 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.963 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x563c69817090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.5e-05 secs_since: 0 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.261+0000 7f6473118c80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2023-12-07T17:02:46.964 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.265+0000 7f6473118c80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2023-12-07T17:02:46.965 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph-mon: stderr debug 2023-12-07T17:02:46.265+0000 7f6473118c80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi172 for mon.smithi172 2023-12-07T17:02:46.965 INFO:teuthology.orchestra.run.smithi172.stdout:create mon.smithi172 on 2023-12-07T17:02:47.368 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2023-12-07T17:02:47.601 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target -> /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target. 2023-12-07T17:02:47.601 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target -> /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target. 2023-12-07T17:02:47.881 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172 2023-12-07T17:02:47.881 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service: Unit ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service not loaded. 2023-12-07T17:02:48.094 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target.wants/ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service -> /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715@.service. 2023-12-07T17:02:48.106 INFO:teuthology.orchestra.run.smithi172.stdout:firewalld does not appear to be present 2023-12-07T17:02:48.107 INFO:teuthology.orchestra.run.smithi172.stdout:Not possible to enable service . firewalld.service is not available 2023-12-07T17:02:48.107 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mon to start... 2023-12-07T17:02:48.107 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mon... 2023-12-07T17:02:49.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:49 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.567089+0000 mon.smithi172 (mon.0) 1 : cluster 1 mon.smithi172 is new leader, mons smithi172 in quorum (ranks 0) 2023-12-07T17:02:50.480 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout cluster: 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout id: 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout services: 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi172 (age 0.221126s) 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout data: 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout pgs: 2023-12-07T17:02:50.481 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:50.482 INFO:teuthology.orchestra.run.smithi172.stdout:mon is available 2023-12-07T17:02:50.482 INFO:teuthology.orchestra.run.smithi172.stdout:Assimilating anything we can from ceph.conf... 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.572890+0000 mon.smithi172 (mon.0) 2 : cluster 1 mon.smithi172 is new leader, mons smithi172 in quorum (ranks 0) 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.573175+0000 mon.smithi172 (mon.0) 3 : cluster 0 monmap e1: 1 mons at {smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.576690+0000 mon.smithi172 (mon.0) 4 : cluster 0 fsmap 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.580083+0000 mon.smithi172 (mon.0) 5 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: cluster 2023-12-07T17:02:49.580810+0000 mon.smithi172 (mon.0) 6 : cluster 0 mgrmap e1: no daemons active 2023-12-07T17:02:50.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:50 smithi172 bash[24373]: audit 2023-12-07T17:02:49.793950+0000 mon.smithi172 (mon.0) 7 : audit 0 from='client.? 172.21.15.172:0/876101987' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-07T17:02:52.119 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:51 smithi172 bash[24373]: audit 2023-12-07T17:02:51.717183+0000 mon.smithi172 (mon.0) 8 : audit 1 from='client.? 172.21.15.172:0/2089902190' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-07T17:02:52.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:51 smithi172 bash[24373]: audit 2023-12-07T17:02:51.722261+0000 mon.smithi172 (mon.0) 9 : audit 1 from='client.? 172.21.15.172:0/2089902190' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [global] 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout fsid = 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.172:3300,v1:172.21.15.172:6789] 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-07T17:02:52.328 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-07T17:02:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-07T17:02:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:02:52.329 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [osd] 2023-12-07T17:02:52.330 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-07T17:02:52.330 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-07T17:02:52.330 INFO:teuthology.orchestra.run.smithi172.stdout:Generating new minimal ceph.conf... 2023-12-07T17:02:53.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:53 smithi172 bash[24373]: audit 2023-12-07T17:02:53.442223+0000 mon.smithi172 (mon.0) 10 : audit 0 from='client.? 172.21.15.172:0/4264632893' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:02:54.079 INFO:teuthology.orchestra.run.smithi172.stdout:Restarting the monitor... 2023-12-07T17:02:54.369 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T17:02:54.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 bash[24373]: debug 2023-12-07T17:02:54.257+0000 7fb5cea13700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-12-07T17:02:54.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 bash[24373]: debug 2023-12-07T17:02:54.257+0000 7fb5cea13700 -1 mon.smithi172@0(leader) e1 *** Got Signal Terminated *** 2023-12-07T17:02:54.981 INFO:teuthology.orchestra.run.smithi172.stdout:Setting public_network to 172.21.0.0/20,172.21.15.254/32 in mon config section 2023-12-07T17:02:55.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 bash[24785]: ceph-4fe67048-9522-11ee-95a2-87774f69a715-mon-smithi172 2023-12-07T17:02:55.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 bash[24861]: Error response from daemon: No such container: ceph-4fe67048-9522-11ee-95a2-87774f69a715-mon-smithi172 2023-12-07T17:02:55.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 systemd[1]: ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service: Succeeded. 2023-12-07T17:02:55.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 systemd[1]: Stopped Ceph mon.smithi172 for 4fe67048-9522-11ee-95a2-87774f69a715. 2023-12-07T17:02:55.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:54 smithi172 systemd[1]: Started Ceph mon.smithi172 for 4fe67048-9522-11ee-95a2-87774f69a715. 2023-12-07T17:02:56.330 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.237+0000 7f2dcf1d8c80 0 set uid:gid to 167:167 (ceph:ceph) 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.237+0000 7f2dcf1d8c80 0 ceph version 19.0.0-64-ge068ebcf (e068ebcf7ecc6503f24666fb6b152034d3fe1067) reef (dev), process ceph-mon, pid 7 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.237+0000 7f2dcf1d8c80 0 pidfile_write: ignore empty --pid-file 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 0 load: jerasure load: lrc 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: RocksDB version: 7.9.2 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Git sha 0 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Compile date 2023-12-06 23:35:10 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: DB SUMMARY 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: DB Session ID: LQVAMC3KO1HY1TS7KFRF 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: CURRENT file: CURRENT 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: IDENTITY file: IDENTITY 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi172/store.db dir, Total Num: 1, files: 000008.sst 2023-12-07T17:02:56.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi172/store.db: 000009.log size: 84826 ; 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.error_if_exists: 0 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.create_if_missing: 0 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.paranoid_checks: 1 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.env: 0x56249d554a60 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.fs: PosixFileSystem 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.info_log: 0x56249e6d5640 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_file_opening_threads: 16 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.statistics: (nil) 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.use_fsync: 0 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_log_file_size: 0 2023-12-07T17:02:56.332 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.log_file_time_to_roll: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.keep_log_file_num: 1000 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.recycle_log_file_num: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_fallocate: 1 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_mmap_reads: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_mmap_writes: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.use_direct_reads: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.create_missing_column_families: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.db_log_dir: 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.wal_dir: 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.table_cache_numshardbits: 6 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-07T17:02:56.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.advise_random_on_open: 1 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.db_write_buffer_size: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.write_buffer_manager: 0x56249e6a92c0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.use_adaptive_mutex: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.rate_limiter: (nil) 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.wal_recovery_mode: 2 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enable_thread_tracking: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enable_pipelined_write: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.unordered_write: 0 2023-12-07T17:02:56.334 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.row_cache: None 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.wal_filter: None 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_ingest_behind: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.two_write_queues: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.manual_wal_flush: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.wal_compression: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.atomic_flush: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.persist_stats_to_disk: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2023-12-07T17:02:56.335 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.log_readahead_size: 0 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.best_efforts_recovery: 0 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.allow_data_in_errors: 0 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.db_host_id: __hostname__ 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enforce_single_del_contracts: true 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_background_jobs: 2 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_background_compactions: -1 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_subcompactions: 1 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.delayed_write_rate : 16777216 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_total_wal_size: 0 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-07T17:02:56.336 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.stats_dump_period_sec: 600 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.stats_persist_period_sec: 600 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_open_files: -1 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bytes_per_sync: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_readahead_size: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_background_flushes: -1 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Compression algorithms supported: 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kZSTD supported: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kXpressCompression supported: 0 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kLZ4HCCompression supported: 1 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kZlibCompression supported: 1 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kSnappyCompression supported: 1 2023-12-07T17:02:56.337 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kLZ4Compression supported: 1 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: kBZip2Compression supported: 0 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.merge_operator: 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_filter: None 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_filter_factory: None 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.sst_partitioner_factory: None 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.table_factory: BlockBasedTable 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56249e6d5740) 2023-12-07T17:02:56.338 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cache_index_and_filter_blocks: 1 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: pin_top_level_index_and_filter: 1 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: index_type: 0 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: data_block_index_type: 0 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: index_shortening: 1 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: data_block_hash_table_util_ratio: 0.750000 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: checksum: 4 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: no_block_cache: 0 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_cache: 0x56249e729090 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_cache_name: BinnedLRUCache 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_cache_options: 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: capacity : 536870912 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: num_shard_bits : 4 2023-12-07T17:02:56.339 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: strict_capacity_limit : 0 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: high_pri_pool_ratio: 0.000 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_cache_compressed: (nil) 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: persistent_cache: (nil) 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_size: 4096 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_size_deviation: 10 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_restart_interval: 16 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: index_block_restart_interval: 1 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: metadata_block_size: 4096 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: partition_filters: 0 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: use_delta_encoding: 1 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: filter_policy: bloomfilter 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: whole_key_filtering: 1 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: verify_compression: 0 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: read_amp_bytes_per_bit: 0 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: format_version: 5 2023-12-07T17:02:56.340 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: enable_index_compression: 1 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: block_align: 0 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: max_auto_readahead_size: 262144 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: prepopulate_block_cache: 0 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: initial_auto_readahead_size: 8192 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: num_file_reads_for_auto_readahead: 2 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.write_buffer_size: 33554432 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_write_buffer_number: 2 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression: NoCompression 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression: Disabled 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.prefix_extractor: nullptr 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.num_levels: 7 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-07T17:02:56.341 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.window_bits: -14 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.level: 32767 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.strategy: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-07T17:02:56.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.enabled: false 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.target_file_size_base: 67108864 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.target_file_size_multiplier: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-07T17:02:56.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.arena_block_size: 1048576 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.disable_auto_compactions: 0 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-07T17:02:56.344 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.table_properties_collectors: 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.inplace_update_support: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.memtable_huge_page_size: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.bloom_locality: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.max_successive_merges: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.paranoid_file_checks: 0 2023-12-07T17:02:56.345 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.force_consistency_checks: 1 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.report_bg_io_stats: 0 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.ttl: 2592000 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enable_blob_files: false 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.min_blob_size: 0 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_file_size: 268435456 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_compression_type: NoCompression 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-07T17:02:56.346 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.blob_file_starting_level: 0 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.241+0000 7f2dcf1d8c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi172/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e118732f-368a-4c5a-9a28-25f6e35d3a7a 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1701968576250713, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1701968576251761, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81471, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 252, "table_properties": {"data_size": 79658, "index_size": 223, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 9997, "raw_average_key_size": 47, "raw_value_size": 73977, "raw_average_value_size": 350, "num_data_blocks": 10, "num_entries": 211, "num_filter_entries": 211, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701968576, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e118732f-368a-4c5a-9a28-25f6e35d3a7a", "db_session_id": "LQVAMC3KO1HY1TS7KFRF", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1701968576251865, "job": 1, "event": "recovery_finished"} 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi172/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56249e7c8000 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 4 rocksdb: DB pointer 0x56249e7b6000 2023-12-07T17:02:56.347 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dbd990700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dbd990700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: ** DB Stats ** 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: ** Compaction Stats [default] ** 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: L0 2/0 81.43 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Sum 2/0 81.43 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-07T17:02:56.348 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: ** Compaction Stats [default] ** 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 124.3 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Uptime(secs): 0.0 total, 0.0 interval 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Flush(GB): cumulative 0.000, interval 0.000 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: AddFile(Total Files): cumulative 0, interval 0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: AddFile(L0 Files): cumulative 0, interval 0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: AddFile(Keys): cumulative 0, interval 0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Cumulative compaction: 0.00 GB write, 10.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Interval compaction: 0.00 GB write, 10.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Block cache BinnedLRUCache@0x56249e729090#7 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.4e-05 secs_since: 0 2023-12-07T17:02:56.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: ** File Read Latency Histogram By Level [default] ** 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.249+0000 7f2dcf1d8c80 0 starting mon.smithi172 rank 0 at public addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] at bind addrs [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi172 fsid 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 1 mon.smithi172@-1(???) e1 preinit fsid 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).mds e1 new map 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).mds e1 print_map 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: e1 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: enable_multiple, ever_enabled_multiple: 1,1 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: legacy client fscid: -1 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: No filesystems configured 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T17:02:56.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 0 mon.smithi172@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: debug 2023-12-07T17:02:56.253+0000 7f2dcf1d8c80 1 mon.smithi172@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cluster 2023-12-07T17:02:56.278905+0000 mon.smithi172 (mon.0) 1 : cluster 1 mon.smithi172 is new leader, mons smithi172 in quorum (ranks 0) 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cluster 2023-12-07T17:02:56.278967+0000 mon.smithi172 (mon.0) 2 : cluster 0 monmap e1: 1 mons at {smithi172=[v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cluster 2023-12-07T17:02:56.279393+0000 mon.smithi172 (mon.0) 3 : cluster 0 fsmap 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cluster 2023-12-07T17:02:56.279418+0000 mon.smithi172 (mon.0) 4 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2023-12-07T17:02:56.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:56 smithi172 bash[24902]: cluster 2023-12-07T17:02:56.279838+0000 mon.smithi172 (mon.0) 5 : cluster 0 mgrmap e1: no daemons active 2023-12-07T17:02:57.199 INFO:teuthology.orchestra.run.smithi172.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-07T17:02:57.225 INFO:teuthology.orchestra.run.smithi172.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-07T17:02:57.225 INFO:teuthology.orchestra.run.smithi172.stdout:Creating mgr... 2023-12-07T17:02:57.225 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying port 0.0.0.0:9283 ... 2023-12-07T17:02:57.226 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying port 0.0.0.0:8765 ... 2023-12-07T17:02:57.226 INFO:teuthology.orchestra.run.smithi172.stdout:Verifying port 0.0.0.0:8443 ... 2023-12-07T17:02:57.529 INFO:teuthology.orchestra.run.smithi172.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-4fe67048-9522-11ee-95a2-87774f69a715@mgr.smithi172.nqsqxd 2023-12-07T17:02:57.529 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Failed to reset failed state of unit ceph-4fe67048-9522-11ee-95a2-87774f69a715@mgr.smithi172.nqsqxd.service: Unit ceph-4fe67048-9522-11ee-95a2-87774f69a715@mgr.smithi172.nqsqxd.service not loaded. 2023-12-07T17:02:57.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:57 smithi172 bash[24902]: audit 2023-12-07T17:02:56.499327+0000 mon.smithi172 (mon.0) 6 : audit 1 from='client.? 172.21.15.172:0/2213209729' entity='client.admin' 2023-12-07T17:02:57.748 INFO:teuthology.orchestra.run.smithi172.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715.target.wants/ceph-4fe67048-9522-11ee-95a2-87774f69a715@mgr.smithi172.nqsqxd.service -> /etc/systemd/system/ceph-4fe67048-9522-11ee-95a2-87774f69a715@.service. 2023-12-07T17:02:57.761 INFO:teuthology.orchestra.run.smithi172.stdout:firewalld does not appear to be present 2023-12-07T17:02:57.761 INFO:teuthology.orchestra.run.smithi172.stdout:Not possible to enable service . firewalld.service is not available 2023-12-07T17:02:57.761 INFO:teuthology.orchestra.run.smithi172.stdout:firewalld does not appear to be present 2023-12-07T17:02:57.761 INFO:teuthology.orchestra.run.smithi172.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2023-12-07T17:02:57.761 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mgr to start... 2023-12-07T17:02:57.762 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mgr... 2023-12-07T17:02:59.855 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:02:59 smithi172 bash[24902]: audit 2023-12-07T17:02:59.644358+0000 mon.smithi172 (mon.0) 7 : audit 0 from='client.? 172.21.15.172:0/1321903419' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T17:03:00.273 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsid": "4fe67048-9522-11ee-95a2-87774f69a715", 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T17:03:00.274 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 0 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "smithi172" 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T17:03:00.275 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T17:03:00.276 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T17:03:00.277 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:00.278 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T17:02:49.575107+0000", 2023-12-07T17:03:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T17:03:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:00.279 INFO:teuthology.orchestra.run.smithi172.stdout:mgr not available, waiting (1/15)... 2023-12-07T17:03:03.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:03 smithi172 bash[24902]: audit 2023-12-07T17:03:03.445194+0000 mon.smithi172 (mon.0) 8 : audit 0 from='client.? 172.21.15.172:0/181550896' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsid": "4fe67048-9522-11ee-95a2-87774f69a715", 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T17:03:04.133 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 0 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "smithi172" 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-07T17:03:04.134 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T17:03:04.135 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T17:03:04.138 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T17:03:04.139 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T17:02:49.575107+0000", 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:04.140 INFO:teuthology.orchestra.run.smithi172.stdout:mgr not available, waiting (2/15)... 2023-12-07T17:03:07.672 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:07 smithi172 bash[24902]: audit 2023-12-07T17:03:07.365713+0000 mon.smithi172 (mon.0) 9 : audit 0 from='client.? 172.21.15.172:0/449808046' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsid": "4fe67048-9522-11ee-95a2-87774f69a715", 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T17:03:07.992 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 0 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "smithi172" 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T17:03:07.993 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T17:03:07.994 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:07.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T17:02:49.575107+0000", 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:07.996 INFO:teuthology.orchestra.run.smithi172.stdout:mgr not available, waiting (3/15)... 2023-12-07T17:03:08.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: cluster 2023-12-07T17:03:07.696153+0000 mon.smithi172 (mon.0) 10 : cluster 1 Activating manager daemon smithi172.nqsqxd 2023-12-07T17:03:08.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: cluster 2023-12-07T17:03:07.702011+0000 mon.smithi172 (mon.0) 11 : cluster 0 mgrmap e2: smithi172.nqsqxd(active, starting, since 0.00598879s) 2023-12-07T17:03:08.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.704224+0000 mon.smithi172 (mon.0) 12 : audit 0 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.704584+0000 mon.smithi172 (mon.0) 13 : audit 0 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.704869+0000 mon.smithi172 (mon.0) 14 : audit 0 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.705056+0000 mon.smithi172 (mon.0) 15 : audit 0 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.705238+0000 mon.smithi172 (mon.0) 16 : audit 0 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.nqsqxd", "id": "smithi172.nqsqxd"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: cluster 2023-12-07T17:03:07.730106+0000 mon.smithi172 (mon.0) 17 : cluster 1 Manager daemon smithi172.nqsqxd is now available 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.742033+0000 mon.smithi172 (mon.0) 18 : audit 1 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/mirror_snapshot_schedule"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.744827+0000 mon.smithi172 (mon.0) 19 : audit 1 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/trash_purge_schedule"}]: dispatch 2023-12-07T17:03:08.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.748680+0000 mon.smithi172 (mon.0) 20 : audit 1 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:08.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.750647+0000 mon.smithi172 (mon.0) 21 : audit 1 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:08.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:08 smithi172 bash[24902]: audit 2023-12-07T17:03:07.752368+0000 mon.smithi172 (mon.0) 22 : audit 1 from='mgr.14100 172.21.15.172:0/2887884259' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:10.019 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:09 smithi172 bash[24902]: cluster 2023-12-07T17:03:08.710055+0000 mon.smithi172 (mon.0) 23 : cluster 0 mgrmap e3: smithi172.nqsqxd(active, since 1.01403s) 2023-12-07T17:03:12.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:11 smithi172 bash[24902]: cluster 2023-12-07T17:03:10.710917+0000 mon.smithi172 (mon.0) 24 : cluster 0 mgrmap e4: smithi172.nqsqxd(active, since 3s) 2023-12-07T17:03:12.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:11 smithi172 bash[24902]: audit 2023-12-07T17:03:11.627240+0000 mon.smithi172 (mon.0) 25 : audit 0 from='client.? 172.21.15.172:0/4215176026' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-07T17:03:12.260 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:12.260 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:12.260 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsid": "4fe67048-9522-11ee-95a2-87774f69a715", 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "health": { 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 0 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "smithi172" 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2023-12-07T17:03:12.261 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-07T17:03:12.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-07T17:03:12.266 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-07T17:03:12.267 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "restful" 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ], 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "modified": "2023-12-07T17:02:49.575107+0000", 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout }, 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:12.268 INFO:teuthology.orchestra.run.smithi172.stdout:mgr is available 2023-12-07T17:03:14.121 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:13 smithi172 bash[24902]: audit 2023-12-07T17:03:13.682796+0000 mon.smithi172 (mon.0) 26 : audit 1 from='client.? 172.21.15.172:0/595663958' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-07T17:03:14.306 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:14.306 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [global] 2023-12-07T17:03:14.306 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout fsid = 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 2023-12-07T17:03:14.307 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout [osd] 2023-12-07T17:03:14.308 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-07T17:03:14.308 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-07T17:03:14.308 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling cephadm module... 2023-12-07T17:03:16.028 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:15 smithi172 bash[24902]: audit 2023-12-07T17:03:15.710024+0000 mon.smithi172 (mon.0) 27 : audit 1 from='client.? 172.21.15.172:0/3089413647' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-07T17:03:16.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:16 smithi172 bash[24902]: audit 2023-12-07T17:03:15.762025+0000 mon.smithi172 (mon.0) 28 : audit 1 from='client.? 172.21.15.172:0/3089413647' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-07T17:03:16.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:16 smithi172 bash[24902]: cluster 2023-12-07T17:03:15.767287+0000 mon.smithi172 (mon.0) 29 : cluster 0 mgrmap e5: smithi172.nqsqxd(active, since 8s) 2023-12-07T17:03:18.369 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:18 smithi172 bash[24902]: audit 2023-12-07T17:03:17.972954+0000 mon.smithi172 (mon.0) 30 : audit 0 from='client.? 172.21.15.172:0/2148753036' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "active_name": "smithi172.nqsqxd", 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:18.615 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for the mgr to restart... 2023-12-07T17:03:18.616 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mgr epoch 5... 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: cluster 2023-12-07T17:03:24.201332+0000 mon.smithi172 (mon.0) 31 : cluster 1 Active manager daemon smithi172.nqsqxd restarted 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: cluster 2023-12-07T17:03:24.201902+0000 mon.smithi172 (mon.0) 32 : cluster 1 Activating manager daemon smithi172.nqsqxd 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: cluster 2023-12-07T17:03:24.210521+0000 mon.smithi172 (mon.0) 33 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: cluster 2023-12-07T17:03:24.210713+0000 mon.smithi172 (mon.0) 34 : cluster 0 mgrmap e6: smithi172.nqsqxd(active, starting, since 0.00900346s) 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: audit 2023-12-07T17:03:24.211915+0000 mon.smithi172 (mon.0) 35 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: audit 2023-12-07T17:03:24.213500+0000 mon.smithi172 (mon.0) 36 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.nqsqxd", "id": "smithi172.nqsqxd"}]: dispatch 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: audit 2023-12-07T17:03:24.214288+0000 mon.smithi172 (mon.0) 37 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: audit 2023-12-07T17:03:24.214495+0000 mon.smithi172 (mon.0) 38 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: audit 2023-12-07T17:03:24.214662+0000 mon.smithi172 (mon.0) 39 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T17:03:24.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:24 smithi172 bash[24902]: cluster 2023-12-07T17:03:24.243500+0000 mon.smithi172 (mon.0) 40 : cluster 1 Manager daemon smithi172.nqsqxd is now available 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: cephadm 2023-12-07T17:03:24.266680+0000 mgr.smithi172.nqsqxd (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.272509+0000 mon.smithi172 (mon.0) 41 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.280311+0000 mon.smithi172 (mon.0) 42 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.287206+0000 mon.smithi172 (mon.0) 43 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.291192+0000 mon.smithi172 (mon.0) 44 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.297481+0000 mon.smithi172 (mon.0) 45 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.311828+0000 mon.smithi172 (mon.0) 46 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/mirror_snapshot_schedule"}]: dispatch 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: audit 2023-12-07T17:03:24.315366+0000 mon.smithi172 (mon.0) 47 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/trash_purge_schedule"}]: dispatch 2023-12-07T17:03:25.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:25 smithi172 bash[24902]: cluster 2023-12-07T17:03:25.213385+0000 mon.smithi172 (mon.0) 48 : cluster 0 mgrmap e7: smithi172.nqsqxd(active, since 1.01167s) 2023-12-07T17:03:25.971 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:03:25.972 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-07T17:03:25.972 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-07T17:03:25.972 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:03:25.972 INFO:teuthology.orchestra.run.smithi172.stdout:mgr epoch 5 is available 2023-12-07T17:03:25.972 INFO:teuthology.orchestra.run.smithi172.stdout:Setting orchestrator backend to cephadm... 2023-12-07T17:03:26.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: audit 2023-12-07T17:03:25.211486+0000 mgr.smithi172.nqsqxd (mgr.14120) 2 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: audit 2023-12-07T17:03:25.225821+0000 mgr.smithi172.nqsqxd (mgr.14120) 3 : audit 0 from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: audit 2023-12-07T17:03:25.328147+0000 mon.smithi172 (mon.0) 49 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: audit 2023-12-07T17:03:25.332452+0000 mon.smithi172 (mon.0) 50 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: cephadm 2023-12-07T17:03:25.547256+0000 mgr.smithi172.nqsqxd (mgr.14120) 4 : cephadm 1 [07/Dec/2023:17:03:25] ENGINE Bus STARTING 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: cephadm 2023-12-07T17:03:25.669567+0000 mgr.smithi172.nqsqxd (mgr.14120) 5 : cephadm 1 [07/Dec/2023:17:03:25] ENGINE Serving on https://172.21.15.172:7150 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: cephadm 2023-12-07T17:03:25.771402+0000 mgr.smithi172.nqsqxd (mgr.14120) 6 : cephadm 1 [07/Dec/2023:17:03:25] ENGINE Serving on http://172.21.15.172:8765 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: cephadm 2023-12-07T17:03:25.771647+0000 mgr.smithi172.nqsqxd (mgr.14120) 7 : cephadm 1 [07/Dec/2023:17:03:25] ENGINE Bus STARTED 2023-12-07T17:03:26.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:26 smithi172 bash[24902]: audit 2023-12-07T17:03:25.821487+0000 mon.smithi172 (mon.0) 51 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:27.601 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:27 smithi172 bash[24902]: cluster 2023-12-07T17:03:26.334431+0000 mon.smithi172 (mon.0) 52 : cluster 0 mgrmap e8: smithi172.nqsqxd(active, since 2s) 2023-12-07T17:03:28.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:28 smithi172 bash[24902]: audit 2023-12-07T17:03:27.335956+0000 mgr.smithi172.nqsqxd (mgr.14120) 8 : audit 0 from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:28.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:28 smithi172 bash[24902]: audit 2023-12-07T17:03:27.342760+0000 mon.smithi172 (mon.0) 53 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:28.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:28 smithi172 bash[24902]: audit 2023-12-07T17:03:27.393314+0000 mon.smithi172 (mon.0) 54 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:29.976 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-07T17:03:29.976 INFO:teuthology.orchestra.run.smithi172.stdout:Generating ssh key... 2023-12-07T17:03:30.369 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:29 smithi172 bash[24902]: audit 2023-12-07T17:03:29.359955+0000 mgr.smithi172.nqsqxd (mgr.14120) 9 : audit 0 from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:33.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:32 smithi172 bash[24902]: audit 2023-12-07T17:03:31.392882+0000 mgr.smithi172.nqsqxd (mgr.14120) 10 : audit 0 from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:33.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:32 smithi172 bash[24902]: cephadm 2023-12-07T17:03:31.393296+0000 mgr.smithi172.nqsqxd (mgr.14120) 11 : cephadm 1 Generating ssh key... 2023-12-07T17:03:33.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:32 smithi172 bash[24902]: audit 2023-12-07T17:03:31.712199+0000 mon.smithi172 (mon.0) 55 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:33.070 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:32 smithi172 bash[24902]: audit 2023-12-07T17:03:31.715457+0000 mon.smithi172 (mon.0) 56 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:34.119 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:33 smithi172 bash[24902]: audit 2023-12-07T17:03:33.749231+0000 mgr.smithi172.nqsqxd (mgr.14120) 12 : audit 0 from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:34.422 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2IfgwtFNwgCbnhPuEbgcH+ajMGmWLLrJMnEVGkQmRVhjmZdMaBYCW6vE436YEUsdSjFxDxDJaiFwDV3CWBUqYMn2krfwFyTzdDsSO0pSMoiute2JXBUS0J95RQeDwpgv9DreuhJ4oQr0e1zTWciiRxb39BXbWG6puGTwQK6+un9LxDOlOnmxSo3nLthobKofz6Fx/k2sNDRt1cCS/h8nwg4+mi2QXnBYxpAGXGj+GO1Zxomcrlc5se9KW1TiqPn5QSalxnTV20Uo/Bk2g8vMfccTyhGI3rN50Ual267ItLgDpdwEctSgEmjw8jARCeWnaTPjWYiSagWZZIzkSwMo3U9VWVSDmTDEsYamPN17GTAqERwd7ogec6j+EP7NiMJR0MtqqWFwhab42SflgFoQZ8oQNI94yhktcd8klYY0LRvNF2Qr3AEfpezHTpxzQFWMOaD+hbnC/faZCWSEeQ7oicv/749NyzuZu46obnrYUjNjUH0syZFwnrp69/VMY9x0= ceph-4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:03:34.423 INFO:teuthology.orchestra.run.smithi172.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-07T17:03:34.423 INFO:teuthology.orchestra.run.smithi172.stdout:Adding key to root@localhost authorized_keys... 2023-12-07T17:03:34.423 INFO:teuthology.orchestra.run.smithi172.stdout:Adding host smithi172... 2023-12-07T17:03:36.119 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:35 smithi172 bash[24902]: audit 2023-12-07T17:03:35.824237+0000 mgr.smithi172.nqsqxd (mgr.14120) 13 : audit 0 from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi172", "addr": "172.21.15.172", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:37.305 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:37 smithi172 bash[24902]: cephadm 2023-12-07T17:03:36.579868+0000 mgr.smithi172.nqsqxd (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi172 2023-12-07T17:03:42.856 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Added host 'smithi172' with addr '172.21.15.172' 2023-12-07T17:03:42.856 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying mon service with default placement... 2023-12-07T17:03:43.369 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:43 smithi172 bash[24902]: audit 2023-12-07T17:03:42.009592+0000 mon.smithi172 (mon.0) 57 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:43.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:43 smithi172 bash[24902]: cephadm 2023-12-07T17:03:42.010411+0000 mgr.smithi172.nqsqxd (mgr.14120) 15 : cephadm 1 Added host smithi172 2023-12-07T17:03:43.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:43 smithi172 bash[24902]: audit 2023-12-07T17:03:42.031449+0000 mon.smithi172 (mon.0) 58 : audit 0 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:03:45.330 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:45 smithi172 bash[24902]: cluster 2023-12-07T17:03:44.216164+0000 mgr.smithi172.nqsqxd (mgr.14120) 16 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:45.331 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:45 smithi172 bash[24902]: audit 2023-12-07T17:03:44.952825+0000 mon.smithi172 (mon.0) 59 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:45.716 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-07T17:03:45.716 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying mgr service with default placement... 2023-12-07T17:03:46.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:46 smithi172 bash[24902]: audit 2023-12-07T17:03:44.947026+0000 mgr.smithi172.nqsqxd (mgr.14120) 17 : audit 0 from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:46.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:46 smithi172 bash[24902]: cephadm 2023-12-07T17:03:44.948374+0000 mgr.smithi172.nqsqxd (mgr.14120) 18 : cephadm 1 Saving service mon spec with placement count:5 2023-12-07T17:03:46.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:46 smithi172 bash[24902]: audit 2023-12-07T17:03:45.362838+0000 mon.smithi172 (mon.0) 60 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:46.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:46 smithi172 bash[24902]: audit 2023-12-07T17:03:45.845790+0000 mon.smithi172 (mon.0) 61 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:47.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:47 smithi172 bash[24902]: cluster 2023-12-07T17:03:46.216442+0000 mgr.smithi172.nqsqxd (mgr.14120) 19 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:47.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:47 smithi172 bash[24902]: audit 2023-12-07T17:03:47.168736+0000 mon.smithi172 (mon.0) 62 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:47.815 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-07T17:03:47.815 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying crash service with default placement... 2023-12-07T17:03:48.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:48 smithi172 bash[24902]: audit 2023-12-07T17:03:47.162985+0000 mgr.smithi172.nqsqxd (mgr.14120) 20 : audit 0 from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:48.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:48 smithi172 bash[24902]: cephadm 2023-12-07T17:03:47.165387+0000 mgr.smithi172.nqsqxd (mgr.14120) 21 : cephadm 1 Saving service mgr spec with placement count:2 2023-12-07T17:03:49.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:49 smithi172 bash[24902]: cluster 2023-12-07T17:03:48.216888+0000 mgr.smithi172.nqsqxd (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:49.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:49 smithi172 bash[24902]: audit 2023-12-07T17:03:49.289469+0000 mon.smithi172 (mon.0) 63 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:49.995 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2023-12-07T17:03:49.996 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying ceph-exporter service with default placement... 2023-12-07T17:03:50.773 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:50 smithi172 bash[24902]: audit 2023-12-07T17:03:49.284027+0000 mgr.smithi172.nqsqxd (mgr.14120) 23 : audit 0 from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:50.773 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:50 smithi172 bash[24902]: cephadm 2023-12-07T17:03:49.285186+0000 mgr.smithi172.nqsqxd (mgr.14120) 24 : cephadm 1 Saving service crash spec with placement * 2023-12-07T17:03:51.682 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:51 smithi172 bash[24902]: cluster 2023-12-07T17:03:50.217275+0000 mgr.smithi172.nqsqxd (mgr.14120) 25 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:52.170 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2023-12-07T17:03:52.171 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying prometheus service with default placement... 2023-12-07T17:03:52.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:52 smithi172 bash[24902]: audit 2023-12-07T17:03:51.443412+0000 mgr.smithi172.nqsqxd (mgr.14120) 26 : audit 0 from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:52.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:52 smithi172 bash[24902]: cephadm 2023-12-07T17:03:51.446622+0000 mgr.smithi172.nqsqxd (mgr.14120) 27 : cephadm 1 Saving service ceph-exporter spec with placement * 2023-12-07T17:03:52.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:52 smithi172 bash[24902]: audit 2023-12-07T17:03:51.451067+0000 mon.smithi172 (mon.0) 64 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:53.619 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:53 smithi172 bash[24902]: cluster 2023-12-07T17:03:52.217763+0000 mgr.smithi172.nqsqxd (mgr.14120) 28 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:53.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:53 smithi172 bash[24902]: audit 2023-12-07T17:03:52.986678+0000 mon.smithi172 (mon.0) 65 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:54.315 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2023-12-07T17:03:54.315 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying grafana service with default placement... 2023-12-07T17:03:54.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:54 smithi172 bash[24902]: audit 2023-12-07T17:03:53.595481+0000 mgr.smithi172.nqsqxd (mgr.14120) 29 : audit 0 from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:54.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:54 smithi172 bash[24902]: cephadm 2023-12-07T17:03:53.602263+0000 mgr.smithi172.nqsqxd (mgr.14120) 30 : cephadm 1 Saving service prometheus spec with placement count:1 2023-12-07T17:03:54.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:54 smithi172 bash[24902]: audit 2023-12-07T17:03:53.607307+0000 mon.smithi172 (mon.0) 66 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:54.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:54 smithi172 bash[24902]: audit 2023-12-07T17:03:54.080531+0000 mon.smithi172 (mon.0) 67 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:55.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:55 smithi172 bash[24902]: cluster 2023-12-07T17:03:54.218057+0000 mgr.smithi172.nqsqxd (mgr.14120) 31 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:56.398 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2023-12-07T17:03:56.398 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying node-exporter service with default placement... 2023-12-07T17:03:57.119 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:56 smithi172 bash[24902]: audit 2023-12-07T17:03:55.738593+0000 mgr.smithi172.nqsqxd (mgr.14120) 32 : audit 0 from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:57.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:56 smithi172 bash[24902]: cephadm 2023-12-07T17:03:55.742148+0000 mgr.smithi172.nqsqxd (mgr.14120) 33 : cephadm 1 Saving service grafana spec with placement count:1 2023-12-07T17:03:57.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:56 smithi172 bash[24902]: audit 2023-12-07T17:03:55.747122+0000 mon.smithi172 (mon.0) 68 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:03:58.046 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:57 smithi172 bash[24902]: cluster 2023-12-07T17:03:56.218489+0000 mgr.smithi172.nqsqxd (mgr.14120) 34 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:03:58.487 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2023-12-07T17:03:58.487 INFO:teuthology.orchestra.run.smithi172.stdout:Deploying alertmanager service with default placement... 2023-12-07T17:03:59.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:58 smithi172 bash[24902]: audit 2023-12-07T17:03:57.800444+0000 mgr.smithi172.nqsqxd (mgr.14120) 35 : audit 0 from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:03:59.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:58 smithi172 bash[24902]: cephadm 2023-12-07T17:03:57.802832+0000 mgr.smithi172.nqsqxd (mgr.14120) 36 : cephadm 1 Saving service node-exporter spec with placement * 2023-12-07T17:03:59.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:58 smithi172 bash[24902]: audit 2023-12-07T17:03:57.808545+0000 mon.smithi172 (mon.0) 69 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:00.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:03:59 smithi172 bash[24902]: cluster 2023-12-07T17:03:58.218894+0000 mgr.smithi172.nqsqxd (mgr.14120) 37 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:01.296 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2023-12-07T17:04:01.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:01 smithi172 bash[24902]: cluster 2023-12-07T17:04:00.219186+0000 mgr.smithi172.nqsqxd (mgr.14120) 38 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:01.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:01 smithi172 bash[24902]: audit 2023-12-07T17:04:00.452081+0000 mgr.smithi172.nqsqxd (mgr.14120) 39 : audit 0 from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:04:01.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:01 smithi172 bash[24902]: cephadm 2023-12-07T17:04:00.454548+0000 mgr.smithi172.nqsqxd (mgr.14120) 40 : cephadm 1 Saving service alertmanager spec with placement count:1 2023-12-07T17:04:01.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:01 smithi172 bash[24902]: audit 2023-12-07T17:04:00.459002+0000 mon.smithi172 (mon.0) 70 : audit 1 from='mgr.14120 172.21.15.172:0/2696652194' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:03.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:03 smithi172 bash[24902]: cluster 2023-12-07T17:04:02.219573+0000 mgr.smithi172.nqsqxd (mgr.14120) 41 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:03.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:03 smithi172 bash[24902]: audit 2023-12-07T17:04:02.911975+0000 mon.smithi172 (mon.0) 71 : audit 1 from='client.? 172.21.15.172:0/2334948226' entity='client.admin' 2023-12-07T17:04:05.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:05 smithi172 bash[24902]: cluster 2023-12-07T17:04:04.219999+0000 mgr.smithi172.nqsqxd (mgr.14120) 42 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:05.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:05 smithi172 bash[24902]: audit 2023-12-07T17:04:05.038731+0000 mon.smithi172 (mon.0) 72 : audit 1 from='client.? 172.21.15.172:0/3088385645' entity='client.admin' 2023-12-07T17:04:05.701 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling the dashboard module... 2023-12-07T17:04:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:07 smithi172 bash[24902]: cluster 2023-12-07T17:04:06.220525+0000 mgr.smithi172.nqsqxd (mgr.14120) 43 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:07.711 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:07 smithi172 bash[24902]: audit 2023-12-07T17:04:07.316163+0000 mon.smithi172 (mon.0) 73 : audit 1 from='client.? 172.21.15.172:0/94890000' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-07T17:04:08.598 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:08 smithi172 bash[24902]: audit 2023-12-07T17:04:07.469735+0000 mon.smithi172 (mon.0) 74 : audit 1 from='client.? 172.21.15.172:0/94890000' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-07T17:04:08.599 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:08 smithi172 bash[24902]: cluster 2023-12-07T17:04:07.474998+0000 mon.smithi172 (mon.0) 75 : cluster 0 mgrmap e9: smithi172.nqsqxd(active, since 43s) 2023-12-07T17:04:10.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:09 smithi172 bash[24902]: audit 2023-12-07T17:04:09.667529+0000 mon.smithi172 (mon.0) 76 : audit 0 from='client.? 172.21.15.172:0/3200712704' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-07T17:04:10.361 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "active_name": "smithi172.nqsqxd", 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for the mgr to restart... 2023-12-07T17:04:10.362 INFO:teuthology.orchestra.run.smithi172.stdout:Waiting for mgr epoch 9... 2023-12-07T17:04:16.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: cluster 2023-12-07T17:04:15.988453+0000 mon.smithi172 (mon.0) 77 : cluster 1 Active manager daemon smithi172.nqsqxd restarted 2023-12-07T17:04:16.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: cluster 2023-12-07T17:04:15.988862+0000 mon.smithi172 (mon.0) 78 : cluster 1 Activating manager daemon smithi172.nqsqxd 2023-12-07T17:04:16.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: cluster 2023-12-07T17:04:15.994635+0000 mon.smithi172 (mon.0) 79 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2023-12-07T17:04:16.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: cluster 2023-12-07T17:04:15.994898+0000 mon.smithi172 (mon.0) 80 : cluster 0 mgrmap e10: smithi172.nqsqxd(active, starting, since 0.00620947s) 2023-12-07T17:04:16.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: audit 2023-12-07T17:04:15.996850+0000 mon.smithi172 (mon.0) 81 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2023-12-07T17:04:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: audit 2023-12-07T17:04:15.998161+0000 mon.smithi172 (mon.0) 82 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.nqsqxd", "id": "smithi172.nqsqxd"}]: dispatch 2023-12-07T17:04:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: audit 2023-12-07T17:04:15.998983+0000 mon.smithi172 (mon.0) 83 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T17:04:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: audit 2023-12-07T17:04:15.999179+0000 mon.smithi172 (mon.0) 84 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T17:04:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: audit 2023-12-07T17:04:15.999365+0000 mon.smithi172 (mon.0) 85 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T17:04:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:16 smithi172 bash[24902]: cluster 2023-12-07T17:04:16.027367+0000 mon.smithi172 (mon.0) 86 : cluster 1 Manager daemon smithi172.nqsqxd is now available 2023-12-07T17:04:17.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:17 smithi172 bash[24902]: audit 2023-12-07T17:04:16.060968+0000 mon.smithi172 (mon.0) 87 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:04:17.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:17 smithi172 bash[24902]: audit 2023-12-07T17:04:16.066826+0000 mon.smithi172 (mon.0) 88 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:04:17.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:17 smithi172 bash[24902]: audit 2023-12-07T17:04:16.091181+0000 mon.smithi172 (mon.0) 89 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/mirror_snapshot_schedule"}]: dispatch 2023-12-07T17:04:17.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:17 smithi172 bash[24902]: audit 2023-12-07T17:04:16.097402+0000 mon.smithi172 (mon.0) 90 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/trash_purge_schedule"}]: dispatch 2023-12-07T17:04:17.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:17 smithi172 bash[24902]: cluster 2023-12-07T17:04:17.000647+0000 mon.smithi172 (mon.0) 91 : cluster 0 mgrmap e11: smithi172.nqsqxd(active, since 1.01196s) 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout { 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout } 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:mgr epoch 9 is available 2023-12-07T17:04:17.761 INFO:teuthology.orchestra.run.smithi172.stdout:Generating a dashboard self-signed certificate... 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: cephadm 2023-12-07T17:04:16.926040+0000 mgr.smithi172.nqsqxd (mgr.14164) 1 : cephadm 1 [07/Dec/2023:17:04:16] ENGINE Bus STARTING 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: audit 2023-12-07T17:04:17.000085+0000 mgr.smithi172.nqsqxd (mgr.14164) 2 : audit 0 from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: audit 2023-12-07T17:04:17.012380+0000 mgr.smithi172.nqsqxd (mgr.14164) 3 : audit 0 from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: cephadm 2023-12-07T17:04:17.048274+0000 mgr.smithi172.nqsqxd (mgr.14164) 4 : cephadm 1 [07/Dec/2023:17:04:17] ENGINE Serving on https://172.21.15.172:7150 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: cephadm 2023-12-07T17:04:17.150299+0000 mgr.smithi172.nqsqxd (mgr.14164) 5 : cephadm 1 [07/Dec/2023:17:04:17] ENGINE Serving on http://172.21.15.172:8765 2023-12-07T17:04:18.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:18 smithi172 bash[24902]: cephadm 2023-12-07T17:04:17.150655+0000 mgr.smithi172.nqsqxd (mgr.14164) 6 : cephadm 1 [07/Dec/2023:17:04:17] ENGINE Bus STARTED 2023-12-07T17:04:19.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:19 smithi172 bash[24902]: cluster 2023-12-07T17:04:18.048705+0000 mon.smithi172 (mon.0) 92 : cluster 0 mgrmap e12: smithi172.nqsqxd(active, since 2s) 2023-12-07T17:04:19.848 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-07T17:04:19.848 INFO:teuthology.orchestra.run.smithi172.stdout:Creating initial admin user... 2023-12-07T17:04:20.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:20 smithi172 bash[24902]: audit 2023-12-07T17:04:19.100941+0000 mgr.smithi172.nqsqxd (mgr.14164) 7 : audit 0 from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:04:20.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:20 smithi172 bash[24902]: audit 2023-12-07T17:04:19.172336+0000 mon.smithi172 (mon.0) 93 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:20.612 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:20 smithi172 bash[24902]: audit 2023-12-07T17:04:19.176952+0000 mon.smithi172 (mon.0) 94 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:22.262 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$bwE3l/8mBNlyY0fKfCnaAeDEhyz2JtUmCzxFWExJEJThmVeC2/7z.", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701968661, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-07T17:04:22.262 INFO:teuthology.orchestra.run.smithi172.stdout:Fetching dashboard port number... 2023-12-07T17:04:22.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:22 smithi172 bash[24902]: audit 2023-12-07T17:04:21.269046+0000 mgr.smithi172.nqsqxd (mgr.14164) 8 : audit 0 from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:04:22.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:22 smithi172 bash[24902]: audit 2023-12-07T17:04:21.504580+0000 mon.smithi172 (mon.0) 95 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:23.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:23 smithi172 bash[24902]: cluster 2023-12-07T17:04:22.513546+0000 mon.smithi172 (mon.0) 96 : cluster 0 mgrmap e13: smithi172.nqsqxd(active, since 6s) 2023-12-07T17:04:23.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:23 smithi172 bash[24902]: audit 2023-12-07T17:04:23.080427+0000 mon.smithi172 (mon.0) 97 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:24.440 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stdout 8443 2023-12-07T17:04:24.440 INFO:teuthology.orchestra.run.smithi172.stdout:firewalld does not appear to be present 2023-12-07T17:04:24.440 INFO:teuthology.orchestra.run.smithi172.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-07T17:04:24.443 INFO:teuthology.orchestra.run.smithi172.stdout:Ceph Dashboard is now available at: 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout: URL: https://smithi172.front.sepia.ceph.com:8443/ 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout: User: admin 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout: Password: z7whlm7bxt 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:24.444 INFO:teuthology.orchestra.run.smithi172.stdout:Saving cluster configuration to /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/config directory 2023-12-07T17:04:24.445 INFO:teuthology.orchestra.run.smithi172.stdout:Enabling autotune for osd_memory_target 2023-12-07T17:04:24.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:24 smithi172 bash[24902]: audit 2023-12-07T17:04:23.721333+0000 mon.smithi172 (mon.0) 98 : audit 0 from='client.? 172.21.15.172:0/384288594' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-07T17:04:24.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:24 smithi172 bash[24902]: audit 2023-12-07T17:04:24.119135+0000 mon.smithi172 (mon.0) 99 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout:Or, if you are only running a single cluster on this host: 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-07T17:04:28.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: ceph telemetry on 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout:For more information see: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:04:28.956 INFO:teuthology.orchestra.run.smithi172.stdout:Bootstrap complete. 2023-12-07T17:04:29.001 INFO:tasks.cephadm:Fetching config... 2023-12-07T17:04:29.001 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:04:29.001 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-07T17:04:29.008 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-07T17:04:29.008 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:04:29.008 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-07T17:04:29.055 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-07T17:04:29.056 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:04:29.056 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/keyring of=/dev/stdout 2023-12-07T17:04:29.107 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-07T17:04:29.107 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:04:29.108 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-07T17:04:29.155 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-07T17:04:29.155 DEBUG:teuthology.orchestra.run.smithi172:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2IfgwtFNwgCbnhPuEbgcH+ajMGmWLLrJMnEVGkQmRVhjmZdMaBYCW6vE436YEUsdSjFxDxDJaiFwDV3CWBUqYMn2krfwFyTzdDsSO0pSMoiute2JXBUS0J95RQeDwpgv9DreuhJ4oQr0e1zTWciiRxb39BXbWG6puGTwQK6+un9LxDOlOnmxSo3nLthobKofz6Fx/k2sNDRt1cCS/h8nwg4+mi2QXnBYxpAGXGj+GO1Zxomcrlc5se9KW1TiqPn5QSalxnTV20Uo/Bk2g8vMfccTyhGI3rN50Ual267ItLgDpdwEctSgEmjw8jARCeWnaTPjWYiSagWZZIzkSwMo3U9VWVSDmTDEsYamPN17GTAqERwd7ogec6j+EP7NiMJR0MtqqWFwhab42SflgFoQZ8oQNI94yhktcd8klYY0LRvNF2Qr3AEfpezHTpxzQFWMOaD+hbnC/faZCWSEeQ7oicv/749NyzuZu46obnrYUjNjUH0syZFwnrp69/VMY9x0= ceph-4fe67048-9522-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-07T17:04:29.220 INFO:teuthology.orchestra.run.smithi172.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2IfgwtFNwgCbnhPuEbgcH+ajMGmWLLrJMnEVGkQmRVhjmZdMaBYCW6vE436YEUsdSjFxDxDJaiFwDV3CWBUqYMn2krfwFyTzdDsSO0pSMoiute2JXBUS0J95RQeDwpgv9DreuhJ4oQr0e1zTWciiRxb39BXbWG6puGTwQK6+un9LxDOlOnmxSo3nLthobKofz6Fx/k2sNDRt1cCS/h8nwg4+mi2QXnBYxpAGXGj+GO1Zxomcrlc5se9KW1TiqPn5QSalxnTV20Uo/Bk2g8vMfccTyhGI3rN50Ual267ItLgDpdwEctSgEmjw8jARCeWnaTPjWYiSagWZZIzkSwMo3U9VWVSDmTDEsYamPN17GTAqERwd7ogec6j+EP7NiMJR0MtqqWFwhab42SflgFoQZ8oQNI94yhktcd8klYY0LRvNF2Qr3AEfpezHTpxzQFWMOaD+hbnC/faZCWSEeQ7oicv/749NyzuZu46obnrYUjNjUH0syZFwnrp69/VMY9x0= ceph-4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:04:29.231 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-07T17:04:29.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:29 smithi172 bash[24902]: audit 2023-12-07T17:04:28.286820+0000 mon.smithi172 (mon.0) 100 : audit 1 from='client.? 172.21.15.172:0/588205897' entity='client.admin' 2023-12-07T17:04:35.477 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:04:37.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: cluster 2023-12-07T17:04:36.000762+0000 mgr.smithi172.nqsqxd (mgr.14164) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:37.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.265855+0000 mon.smithi172 (mon.0) 101 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.272072+0000 mon.smithi172 (mon.0) 102 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.272997+0000 mon.smithi172 (mon.0) 103 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.281587+0000 mon.smithi172 (mon.0) 104 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.284559+0000 mon.smithi172 (mon.0) 105 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.292807+0000 mon.smithi172 (mon.0) 106 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi172", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2023-12-07T17:04:37.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: audit 2023-12-07T17:04:36.295032+0000 mon.smithi172 (mon.0) 107 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:04:37.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:37 smithi172 bash[24902]: cephadm 2023-12-07T17:04:36.296390+0000 mgr.smithi172.nqsqxd (mgr.14164) 10 : cephadm 1 Deploying daemon ceph-exporter.smithi172 on smithi172 2023-12-07T17:04:39.553 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:39 smithi172 bash[24902]: cluster 2023-12-07T17:04:38.001172+0000 mgr.smithi172.nqsqxd (mgr.14164) 11 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:40.238 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-07T17:04:40.238 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-07T17:04:40.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:39.509003+0000 mon.smithi172 (mon.0) 108 : audit 1 from='client.? 172.21.15.172:0/1980956864' entity='client.admin' 2023-12-07T17:04:40.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.200842+0000 mon.smithi172 (mon.0) 109 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:40.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.206767+0000 mon.smithi172 (mon.0) 110 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:40.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.225398+0000 mon.smithi172 (mon.0) 111 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:40.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.231482+0000 mon.smithi172 (mon.0) 112 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:40.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.233333+0000 mon.smithi172 (mon.0) 113 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2023-12-07T17:04:40.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.236723+0000 mon.smithi172 (mon.0) 114 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi172", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2023-12-07T17:04:40.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:40 smithi172 bash[24902]: audit 2023-12-07T17:04:40.239379+0000 mon.smithi172 (mon.0) 115 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:04:41.833 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:41 smithi172 bash[24902]: cluster 2023-12-07T17:04:40.001592+0000 mgr.smithi172.nqsqxd (mgr.14164) 12 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:41.833 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:41 smithi172 bash[24902]: cephadm 2023-12-07T17:04:40.240679+0000 mgr.smithi172.nqsqxd (mgr.14164) 13 : cephadm 1 Deploying daemon crash.smithi172 on smithi172 2023-12-07T17:04:41.833 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:41 smithi172 bash[24902]: audit 2023-12-07T17:04:41.089895+0000 mon.smithi172 (mon.0) 116 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:43.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:43 smithi172 bash[24902]: cluster 2023-12-07T17:04:42.001992+0000 mgr.smithi172.nqsqxd (mgr.14164) 14 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:43.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:43 smithi172 bash[24902]: audit 2023-12-07T17:04:43.299485+0000 mon.smithi172 (mon.0) 117 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:43.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:43 smithi172 bash[24902]: audit 2023-12-07T17:04:43.303524+0000 mon.smithi172 (mon.0) 118 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:43.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:43 smithi172 bash[24902]: audit 2023-12-07T17:04:43.317092+0000 mon.smithi172 (mon.0) 119 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:43.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:43 smithi172 bash[24902]: audit 2023-12-07T17:04:43.323912+0000 mon.smithi172 (mon.0) 120 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:44.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:44 smithi172 bash[24902]: cephadm 2023-12-07T17:04:43.326387+0000 mgr.smithi172.nqsqxd (mgr.14164) 15 : cephadm 1 Deploying daemon node-exporter.smithi172 on smithi172 2023-12-07T17:04:44.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:44 smithi172 bash[24902]: audit 2023-12-07T17:04:44.468098+0000 mon.smithi172 (mon.0) 121 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:44.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:44 smithi172 bash[24902]: audit 2023-12-07T17:04:44.473850+0000 mon.smithi172 (mon.0) 122 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:44.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:44 smithi172 bash[24902]: audit 2023-12-07T17:04:44.498524+0000 mon.smithi172 (mon.0) 123 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:44.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:44 smithi172 bash[24902]: audit 2023-12-07T17:04:44.504673+0000 mon.smithi172 (mon.0) 124 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:45.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:45 smithi172 bash[24902]: cluster 2023-12-07T17:04:44.002438+0000 mgr.smithi172.nqsqxd (mgr.14164) 16 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:45.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:45 smithi172 bash[24902]: cephadm 2023-12-07T17:04:44.516796+0000 mgr.smithi172.nqsqxd (mgr.14164) 17 : cephadm 1 Deploying daemon alertmanager.smithi172 on smithi172 2023-12-07T17:04:46.953 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:04:47.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:47 smithi172 bash[24902]: cluster 2023-12-07T17:04:46.002758+0000 mgr.smithi172.nqsqxd (mgr.14164) 18 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:47.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:47 smithi172 bash[24902]: audit 2023-12-07T17:04:46.094510+0000 mon.smithi172 (mon.0) 125 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:49.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:49 smithi172 bash[24902]: cluster 2023-12-07T17:04:48.003185+0000 mgr.smithi172.nqsqxd (mgr.14164) 19 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:51.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:51 smithi172 bash[24902]: cluster 2023-12-07T17:04:50.003613+0000 mgr.smithi172.nqsqxd (mgr.14164) 20 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:53.561 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:53 smithi172 bash[24902]: cluster 2023-12-07T17:04:52.004049+0000 mgr.smithi172.nqsqxd (mgr.14164) 21 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:54.779 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:54 smithi172 bash[24902]: audit 2023-12-07T17:04:53.530634+0000 mgr.smithi172.nqsqxd (mgr.14164) 22 : audit 0 from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:04:54.779 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:54 smithi172 bash[24902]: audit 2023-12-07T17:04:53.534918+0000 mon.smithi172 (mon.0) 126 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:54.780 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-07T17:04:54.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-07T17:04:55.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:55 smithi172 bash[24902]: cluster 2023-12-07T17:04:54.004493+0000 mgr.smithi172.nqsqxd (mgr.14164) 23 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:57.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: cluster 2023-12-07T17:04:56.004927+0000 mgr.smithi172.nqsqxd (mgr.14164) 24 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.703032+0000 mon.smithi172 (mon.0) 127 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.708117+0000 mon.smithi172 (mon.0) 128 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.761638+0000 mon.smithi172 (mon.0) 129 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.764397+0000 mon.smithi172 (mon.0) 130 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.767500+0000 mon.smithi172 (mon.0) 131 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.769831+0000 mon.smithi172 (mon.0) 132 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.863048+0000 mon.smithi172 (mon.0) 133 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.867309+0000 mon.smithi172 (mon.0) 134 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.869297+0000 mon.smithi172 (mon.0) 135 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-07T17:04:57.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:57 smithi172 bash[24902]: audit 2023-12-07T17:04:56.871627+0000 mon.smithi172 (mon.0) 136 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:04:58.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:58 smithi172 bash[24902]: cephadm 2023-12-07T17:04:56.779916+0000 mgr.smithi172.nqsqxd (mgr.14164) 25 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2023-12-07T17:04:58.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:58 smithi172 bash[24902]: audit 2023-12-07T17:04:56.869769+0000 mgr.smithi172.nqsqxd (mgr.14164) 26 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2023-12-07T17:04:58.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:58 smithi172 bash[24902]: cephadm 2023-12-07T17:04:56.878803+0000 mgr.smithi172.nqsqxd (mgr.14164) 27 : cephadm 1 Deploying daemon grafana.smithi172 on smithi172 2023-12-07T17:04:59.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:04:59 smithi172 bash[24902]: cluster 2023-12-07T17:04:58.005328+0000 mgr.smithi172.nqsqxd (mgr.14164) 28 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:00.516 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:05:01.868 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:01 smithi172 bash[24902]: cluster 2023-12-07T17:05:00.005716+0000 mgr.smithi172.nqsqxd (mgr.14164) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:01.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:01 smithi172 bash[24902]: audit 2023-12-07T17:05:01.099910+0000 mon.smithi172 (mon.0) 137 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:03.828 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:03 smithi172 bash[24902]: cluster 2023-12-07T17:05:02.006018+0000 mgr.smithi172.nqsqxd (mgr.14164) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:05.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:05 smithi172 bash[24902]: cluster 2023-12-07T17:05:04.006330+0000 mgr.smithi172.nqsqxd (mgr.14164) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:07.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:07 smithi172 bash[24902]: cluster 2023-12-07T17:05:06.006660+0000 mgr.smithi172.nqsqxd (mgr.14164) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:09.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:09 smithi172 bash[24902]: cluster 2023-12-07T17:05:08.006967+0000 mgr.smithi172.nqsqxd (mgr.14164) 33 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:10.299 INFO:teuthology.orchestra.run.smithi172.stderr:adjusted tunables profile to default 2023-12-07T17:05:10.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:10 smithi172 bash[24902]: audit 2023-12-07T17:05:09.842393+0000 mon.smithi172 (mon.0) 138 : audit 1 from='client.? 172.21.15.172:0/2771410812' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-07T17:05:11.620 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:11 smithi172 bash[24902]: cluster 2023-12-07T17:05:10.007227+0000 mgr.smithi172.nqsqxd (mgr.14164) 34 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:11.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:11 smithi172 bash[24902]: audit 2023-12-07T17:05:10.299132+0000 mon.smithi172 (mon.0) 139 : audit 1 from='client.? 172.21.15.172:0/2771410812' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-07T17:05:11.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:11 smithi172 bash[24902]: cluster 2023-12-07T17:05:10.301579+0000 mon.smithi172 (mon.0) 140 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2023-12-07T17:05:12.048 INFO:tasks.cephadm:Adding mon.smithi172 on smithi172 2023-12-07T17:05:12.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch apply mon '1;smithi172:172.21.15.172=smithi172' 2023-12-07T17:05:13.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:13 smithi172 bash[24902]: cluster 2023-12-07T17:05:12.007577+0000 mgr.smithi172.nqsqxd (mgr.14164) 35 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:15.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:15 smithi172 bash[24902]: cluster 2023-12-07T17:05:14.008013+0000 mgr.smithi172.nqsqxd (mgr.14164) 36 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:16.826 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.434762+0000 mon.smithi172 (mon.0) 141 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:16.826 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.438806+0000 mon.smithi172 (mon.0) 142 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.483802+0000 mon.smithi172 (mon.0) 143 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.487412+0000 mon.smithi172 (mon.0) 144 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.489784+0000 mon.smithi172 (mon.0) 145 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.occzht", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.490835+0000 mon.smithi172 (mon.0) 146 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.occzht", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.492836+0000 mon.smithi172 (mon.0) 147 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:15.493968+0000 mon.smithi172 (mon.0) 148 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: cephadm 2023-12-07T17:05:15.495114+0000 mgr.smithi172.nqsqxd (mgr.14164) 37 : cephadm 1 Deploying daemon mgr.smithi172.occzht on smithi172 2023-12-07T17:05:16.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:16 smithi172 bash[24902]: audit 2023-12-07T17:05:16.106604+0000 mon.smithi172 (mon.0) 149 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:17.807 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:17 smithi172 bash[24902]: cluster 2023-12-07T17:05:16.008418+0000 mgr.smithi172.nqsqxd (mgr.14164) 38 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:18.856 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:05:19.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: cluster 2023-12-07T17:05:18.008870+0000 mgr.smithi172.nqsqxd (mgr.14164) 39 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:19.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.753814+0000 mon.smithi172 (mon.0) 150 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.760044+0000 mon.smithi172 (mon.0) 151 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.768905+0000 mon.smithi172 (mon.0) 152 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.775650+0000 mon.smithi172 (mon.0) 153 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.662 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.781983+0000 mon.smithi172 (mon.0) 154 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.662 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.787469+0000 mon.smithi172 (mon.0) 155 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:19.662 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:19 smithi172 bash[24902]: audit 2023-12-07T17:05:18.793114+0000 mon.smithi172 (mon.0) 156 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:20.609 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:20 smithi172 bash[24902]: cephadm 2023-12-07T17:05:19.031905+0000 mgr.smithi172.nqsqxd (mgr.14164) 40 : cephadm 1 Deploying daemon prometheus.smithi172 on smithi172 2023-12-07T17:05:21.766 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:21 smithi172 bash[24902]: cluster 2023-12-07T17:05:20.009213+0000 mgr.smithi172.nqsqxd (mgr.14164) 41 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:21.766 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:21 smithi172 bash[24902]: audit 2023-12-07T17:05:21.112335+0000 mon.smithi172 (mon.0) 157 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:23.585 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:23 smithi172 bash[24902]: cluster 2023-12-07T17:05:22.009472+0000 mgr.smithi172.nqsqxd (mgr.14164) 42 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:25.809 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:25 smithi172 bash[24902]: cluster 2023-12-07T17:05:24.009776+0000 mgr.smithi172.nqsqxd (mgr.14164) 43 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:26.912 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled mon update... 2023-12-07T17:05:27.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:27 smithi172 bash[24902]: cluster 2023-12-07T17:05:26.010021+0000 mgr.smithi172.nqsqxd (mgr.14164) 44 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:27.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:27 smithi172 bash[24902]: audit 2023-12-07T17:05:26.915298+0000 mon.smithi172 (mon.0) 158 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:28.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:28 smithi172 bash[24902]: audit 2023-12-07T17:05:26.910496+0000 mgr.smithi172.nqsqxd (mgr.14164) 45 : audit 0 from='client.14195 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "1;smithi172:172.21.15.172=smithi172", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:05:28.751 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:28 smithi172 bash[24902]: cephadm 2023-12-07T17:05:26.912755+0000 mgr.smithi172.nqsqxd (mgr.14164) 46 : cephadm 1 Saving service mon spec with placement smithi172:172.21.15.172=smithi172;count:1 2023-12-07T17:05:29.194 INFO:tasks.cephadm:Waiting for 1 mons in monmap... 2023-12-07T17:05:29.194 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-07T17:05:29.739 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:29 smithi172 bash[24902]: cluster 2023-12-07T17:05:28.010278+0000 mgr.smithi172.nqsqxd (mgr.14164) 47 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:31.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:31 smithi172 bash[24902]: cluster 2023-12-07T17:05:30.010689+0000 mgr.smithi172.nqsqxd (mgr.14164) 48 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:31.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:31 smithi172 bash[24902]: cluster 2023-12-07T17:05:30.567888+0000 mon.smithi172 (mon.0) 159 : cluster 0 Standby manager daemon smithi172.occzht started 2023-12-07T17:05:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:32 smithi172 bash[24902]: cluster 2023-12-07T17:05:31.524343+0000 mon.smithi172 (mon.0) 160 : cluster 0 mgrmap e14: smithi172.nqsqxd(active, since 75s), standbys: smithi172.occzht 2023-12-07T17:05:32.621 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:32 smithi172 bash[24902]: audit 2023-12-07T17:05:31.524496+0000 mon.smithi172 (mon.0) 161 : audit 0 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.occzht", "id": "smithi172.occzht"}]: dispatch 2023-12-07T17:05:33.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:33 smithi172 bash[24902]: cluster 2023-12-07T17:05:32.010984+0000 mgr.smithi172.nqsqxd (mgr.14164) 49 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:34.845 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:05:35.871 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:35 smithi172 bash[24902]: cluster 2023-12-07T17:05:34.011414+0000 mgr.smithi172.nqsqxd (mgr.14164) 50 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:37.671 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:37 smithi172 bash[24902]: cluster 2023-12-07T17:05:36.011882+0000 mgr.smithi172.nqsqxd (mgr.14164) 51 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:39.720 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:39 smithi172 bash[24902]: cluster 2023-12-07T17:05:38.012291+0000 mgr.smithi172.nqsqxd (mgr.14164) 52 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:05:39.720 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:39 smithi172 bash[24902]: audit 2023-12-07T17:05:39.077922+0000 mon.smithi172 (mon.0) 162 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:39.720 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:39 smithi172 bash[24902]: audit 2023-12-07T17:05:39.083227+0000 mon.smithi172 (mon.0) 163 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:39.721 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:39 smithi172 bash[24902]: audit 2023-12-07T17:05:39.091538+0000 mon.smithi172 (mon.0) 164 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:39.721 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:39 smithi172 bash[24902]: audit 2023-12-07T17:05:39.094703+0000 mon.smithi172 (mon.0) 165 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2023-12-07T17:05:41.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:41 smithi172 bash[24902]: audit 2023-12-07T17:05:40.093051+0000 mon.smithi172 (mon.0) 166 : audit 1 from='mgr.14164 172.21.15.172:0/2607798940' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2023-12-07T17:05:41.220 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:41 smithi172 bash[24902]: cluster 2023-12-07T17:05:40.099870+0000 mon.smithi172 (mon.0) 167 : cluster 0 mgrmap e15: smithi172.nqsqxd(active, since 84s), standbys: smithi172.occzht 2023-12-07T17:05:41.337 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:05:41.337 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":1,"fsid":"4fe67048-9522-11ee-95a2-87774f69a715","modified":"2023-12-07T17:02:44.868325Z","created":"2023-12-07T17:02:44.868325Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi172","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:3300","nonce":0},{"type":"v1","addr":"172.21.15.172:6789","nonce":0}]},"addr":"172.21.15.172:6789/0","public_addr":"172.21.15.172:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-07T17:05:41.342 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1 2023-12-07T17:05:42.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:42 smithi172 bash[24902]: audit 2023-12-07T17:05:41.340981+0000 mon.smithi172 (mon.0) 168 : audit 0 from='client.? 172.21.15.172:0/1393184810' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-07T17:05:42.544 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-07T17:05:42.544 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-07T17:05:47.273 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:48.959837+0000 mon.smithi172 (mon.0) 169 : cluster 1 Active manager daemon smithi172.nqsqxd restarted 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:48.960096+0000 mon.smithi172 (mon.0) 170 : cluster 1 Activating manager daemon smithi172.nqsqxd 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:48.966611+0000 mon.smithi172 (mon.0) 171 : cluster 0 osdmap e5: 0 total, 0 up, 0 in 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:48.966865+0000 mon.smithi172 (mon.0) 172 : cluster 0 mgrmap e16: smithi172.nqsqxd(active, starting, since 0.00687657s), standbys: smithi172.occzht 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.969337+0000 mon.smithi172 (mon.0) 173 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.971230+0000 mon.smithi172 (mon.0) 174 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.nqsqxd", "id": "smithi172.nqsqxd"}]: dispatch 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.971435+0000 mon.smithi172 (mon.0) 175 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr metadata", "who": "smithi172.occzht", "id": "smithi172.occzht"}]: dispatch 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.972294+0000 mon.smithi172 (mon.0) 176 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-07T17:05:49.153 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.972521+0000 mon.smithi172 (mon.0) 177 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-07T17:05:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: audit 2023-12-07T17:05:48.972651+0000 mon.smithi172 (mon.0) 178 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-07T17:05:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:49.002360+0000 mon.smithi172 (mon.0) 179 : cluster 1 Manager daemon smithi172.nqsqxd is now available 2023-12-07T17:05:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:49.007945+0000 mon.smithi172 (mon.0) 180 : cluster 0 Standby manager daemon smithi172.occzht restarted 2023-12-07T17:05:49.154 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:49 smithi172 bash[24902]: cluster 2023-12-07T17:05:49.008078+0000 mon.smithi172 (mon.0) 181 : cluster 0 Standby manager daemon smithi172.occzht started 2023-12-07T17:05:50.202 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.038817+0000 mon.smithi172 (mon.0) 182 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.040674+0000 mon.smithi172 (mon.0) 183 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.062410+0000 mon.smithi172 (mon.0) 184 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.066591+0000 mon.smithi172 (mon.0) 185 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.082622+0000 mon.smithi172 (mon.0) 186 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/mirror_snapshot_schedule"}]: dispatch 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: audit 2023-12-07T17:05:49.098770+0000 mon.smithi172 (mon.0) 187 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi172.nqsqxd/trash_purge_schedule"}]: dispatch 2023-12-07T17:05:50.203 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:50 smithi172 bash[24902]: cluster 2023-12-07T17:05:49.972940+0000 mon.smithi172 (mon.0) 188 : cluster 0 mgrmap e17: smithi172.nqsqxd(active, since 1.01295s), standbys: smithi172.occzht 2023-12-07T17:05:52.055 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:52 smithi172 bash[24902]: cephadm 2023-12-07T17:05:50.220631+0000 mgr.smithi172.nqsqxd (mgr.14199) 1 : cephadm 1 [07/Dec/2023:17:05:50] ENGINE Bus STARTING 2023-12-07T17:05:52.055 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:52 smithi172 bash[24902]: cephadm 2023-12-07T17:05:50.335548+0000 mgr.smithi172.nqsqxd (mgr.14199) 2 : cephadm 1 [07/Dec/2023:17:05:50] ENGINE Serving on https://172.21.15.172:7150 2023-12-07T17:05:52.055 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:52 smithi172 bash[24902]: cephadm 2023-12-07T17:05:50.437665+0000 mgr.smithi172.nqsqxd (mgr.14199) 3 : cephadm 1 [07/Dec/2023:17:05:50] ENGINE Serving on http://172.21.15.172:8765 2023-12-07T17:05:52.055 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:52 smithi172 bash[24902]: cephadm 2023-12-07T17:05:50.438065+0000 mgr.smithi172.nqsqxd (mgr.14199) 4 : cephadm 1 [07/Dec/2023:17:05:50] ENGINE Bus STARTED 2023-12-07T17:05:52.056 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:52 smithi172 bash[24902]: cluster 2023-12-07T17:05:51.025339+0000 mon.smithi172 (mon.0) 189 : cluster 0 mgrmap e18: smithi172.nqsqxd(active, since 2s), standbys: smithi172.occzht 2023-12-07T17:05:52.247 INFO:teuthology.orchestra.run.smithi172.stdout:# minimal ceph.conf for 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:05:52.248 INFO:teuthology.orchestra.run.smithi172.stdout:[global] 2023-12-07T17:05:52.248 INFO:teuthology.orchestra.run.smithi172.stdout: fsid = 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T17:05:52.248 INFO:teuthology.orchestra.run.smithi172.stdout: mon_host = [v2:172.21.15.172:3300/0,v1:172.21.15.172:6789/0] 2023-12-07T17:05:53.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:53 smithi172 bash[24902]: audit 2023-12-07T17:05:52.251053+0000 mon.smithi172 (mon.0) 190 : audit 0 from='client.? 172.21.15.172:0/3987199450' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:05:53.360 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-07T17:05:53.360 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:05:53.360 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.conf 2023-12-07T17:05:53.370 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:05:53.370 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-07T17:05:53.432 INFO:tasks.cephadm:Deploying OSDs... 2023-12-07T17:05:53.432 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:05:53.432 DEBUG:teuthology.orchestra.run.smithi172:> dd if=/scratch_devs of=/dev/stdout 2023-12-07T17:05:53.481 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-07T17:05:53.481 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_1 2023-12-07T17:05:53.529 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-07T17:05:53.529 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 491 Links: 1 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-12-07 16:59:59.049553535 +0000 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-12-07 16:59:58.285572014 +0000 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-12-07 16:59:58.285572014 +0000 2023-12-07T17:05:53.530 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-12-07T17:05:53.530 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-07T17:05:53.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-12-07T17:05:53.585 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-12-07T17:05:53.585 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000401298 s, 1.3 MB/s 2023-12-07T17:05:53.586 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-07T17:05:53.635 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_2 2023-12-07T17:05:53.685 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 497 Links: 1 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-12-07 17:00:00.133527321 +0000 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-12-07 16:59:59.269548214 +0000 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-12-07 16:59:59.269548214 +0000 2023-12-07T17:05:53.686 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-12-07T17:05:53.686 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-07T17:05:53.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-12-07T17:05:53.741 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-12-07T17:05:53.741 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000376369 s, 1.4 MB/s 2023-12-07T17:05:53.742 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-07T17:05:53.799 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_3 2023-12-07T17:05:53.848 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-12-07 17:00:01.189501787 +0000 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-12-07 17:00:00.373521518 +0000 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-12-07 17:00:00.373521518 +0000 2023-12-07T17:05:53.850 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-12-07T17:05:53.850 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-07T17:05:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-12-07T17:05:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-12-07T17:05:53.905 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000407252 s, 1.3 MB/s 2023-12-07T17:05:53.906 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-07T17:05:53.959 DEBUG:teuthology.orchestra.run.smithi172:> stat /dev/vg_nvme/lv_4 2023-12-07T17:05:54.013 INFO:teuthology.orchestra.run.smithi172.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-07T17:05:54.013 INFO:teuthology.orchestra.run.smithi172.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout:Device: 5h/5d Inode: 508 Links: 1 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout:Access: 2023-12-07 17:00:02.001482156 +0000 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout:Modify: 2023-12-07 17:00:01.413496372 +0000 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout:Change: 2023-12-07 17:00:01.413496372 +0000 2023-12-07T17:05:54.014 INFO:teuthology.orchestra.run.smithi172.stdout: Birth: - 2023-12-07T17:05:54.014 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-07T17:05:54.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records in 2023-12-07T17:05:54.069 INFO:teuthology.orchestra.run.smithi172.stderr:1+0 records out 2023-12-07T17:05:54.069 INFO:teuthology.orchestra.run.smithi172.stderr:512 bytes copied, 0.000397669 s, 1.3 MB/s 2023-12-07T17:05:54.070 DEBUG:teuthology.orchestra.run.smithi172:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-07T17:05:54.121 INFO:tasks.cephadm:Deploying osd.0 on smithi172 with /dev/vg_nvme/lv_4... 2023-12-07T17:05:54.121 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-07T17:05:57.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:56 smithi172 bash[24902]: audit 2023-12-07T17:05:55.764739+0000 mon.smithi172 (mon.0) 191 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:57.120 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:56 smithi172 bash[24902]: audit 2023-12-07T17:05:55.770478+0000 mon.smithi172 (mon.0) 192 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:56.919065+0000 mon.smithi172 (mon.0) 193 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:56.923996+0000 mon.smithi172 (mon.0) 194 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:56.925199+0000 mon.smithi172 (mon.0) 195 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd/host:smithi172", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:56.926278+0000 mon.smithi172 (mon.0) 196 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:56.927480+0000 mon.smithi172 (mon.0) 197 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: cephadm 2023-12-07T17:05:56.929129+0000 mgr.smithi172.nqsqxd (mgr.14199) 5 : cephadm 1 Updating smithi172:/etc/ceph/ceph.conf 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: cephadm 2023-12-07T17:05:57.097723+0000 mgr.smithi172.nqsqxd (mgr.14199) 6 : cephadm 1 Updating smithi172:/var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-07T17:05:58.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.600750+0000 mon.smithi172 (mon.0) 198 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.606691+0000 mon.smithi172 (mon.0) 199 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.612125+0000 mon.smithi172 (mon.0) 200 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.620558+0000 mon.smithi172 (mon.0) 201 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.630512+0000 mon.smithi172 (mon.0) 202 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.664227+0000 mon.smithi172 (mon.0) 203 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.666136+0000 mon.smithi172 (mon.0) 204 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-07T17:05:58.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:57 smithi172 bash[24902]: audit 2023-12-07T17:05:57.667926+0000 mon.smithi172 (mon.0) 205 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:05:58.397 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:05:59.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:58 smithi172 bash[24902]: cephadm 2023-12-07T17:05:57.262648+0000 mgr.smithi172.nqsqxd (mgr.14199) 7 : cephadm 1 Updating smithi172:/etc/ceph/ceph.client.admin.keyring 2023-12-07T17:05:59.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:58 smithi172 bash[24902]: cephadm 2023-12-07T17:05:57.427168+0000 mgr.smithi172.nqsqxd (mgr.14199) 8 : cephadm 1 Updating smithi172:/var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-07T17:05:59.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:58 smithi172 bash[24902]: cephadm 2023-12-07T17:05:57.663451+0000 mgr.smithi172.nqsqxd (mgr.14199) 9 : cephadm 1 Reconfiguring mon.smithi172 (unknown last config time)... 2023-12-07T17:05:59.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:05:58 smithi172 bash[24902]: cephadm 2023-12-07T17:05:57.669928+0000 mgr.smithi172.nqsqxd (mgr.14199) 10 : cephadm 1 Reconfiguring daemon mon.smithi172 on smithi172 2023-12-07T17:06:02.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: audit 2023-12-07T17:06:00.987145+0000 mon.smithi172 (mon.0) 206 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:02.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: audit 2023-12-07T17:06:00.992685+0000 mon.smithi172 (mon.0) 207 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:02.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: cephadm 2023-12-07T17:06:01.040895+0000 mgr.smithi172.nqsqxd (mgr.14199) 11 : cephadm 1 Reconfiguring mgr.smithi172.nqsqxd (unknown last config time)... 2023-12-07T17:06:02.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: audit 2023-12-07T17:06:01.041791+0000 mon.smithi172 (mon.0) 208 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi172.nqsqxd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-07T17:06:02.288 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: audit 2023-12-07T17:06:01.043886+0000 mon.smithi172 (mon.0) 209 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-07T17:06:02.288 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: audit 2023-12-07T17:06:01.046104+0000 mon.smithi172 (mon.0) 210 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:06:02.288 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:01 smithi172 bash[24902]: cephadm 2023-12-07T17:06:01.047890+0000 mgr.smithi172.nqsqxd (mgr.14199) 12 : cephadm 1 Reconfiguring daemon mgr.smithi172.nqsqxd on smithi172 2023-12-07T17:06:03.055 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-07T17:06:03.055 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-07T17:06:03.055 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-12-07T17:06:03.056 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-12-07T17:06:03.056 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0178313 s, 588 MB/s 2023-12-07T17:06:03.056 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-12-07T17:06:03.988 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_4 2023-12-07T17:06:04.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:04 smithi172 bash[24902]: audit 2023-12-07T17:06:03.642951+0000 mon.smithi172 (mon.0) 211 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:04.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:04 smithi172 bash[24902]: audit 2023-12-07T17:06:03.647909+0000 mon.smithi172 (mon.0) 212 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:04.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:04 smithi172 bash[24902]: cephadm 2023-12-07T17:06:03.668884+0000 mgr.smithi172.nqsqxd (mgr.14199) 13 : cephadm 1 Reconfiguring alertmanager.smithi172 (dependencies changed)... 2023-12-07T17:06:04.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:04 smithi172 bash[24902]: cephadm 2023-12-07T17:06:03.691554+0000 mgr.smithi172.nqsqxd (mgr.14199) 14 : cephadm 1 Reconfiguring daemon alertmanager.smithi172 on smithi172 2023-12-07T17:06:04.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:04 smithi172 bash[24902]: audit 2023-12-07T17:06:04.067746+0000 mon.smithi172 (mon.0) 213 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:06:09.034 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:06:09.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:09 smithi172 bash[24902]: audit 2023-12-07T17:06:08.592241+0000 mon.smithi172 (mon.0) 214 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:09.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:09 smithi172 bash[24902]: audit 2023-12-07T17:06:08.600446+0000 mon.smithi172 (mon.0) 215 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:09.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:09 smithi172 bash[24902]: cephadm 2023-12-07T17:06:08.616467+0000 mgr.smithi172.nqsqxd (mgr.14199) 15 : cephadm 1 Reconfiguring grafana.smithi172 (dependencies changed)... 2023-12-07T17:06:09.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:09 smithi172 bash[24902]: cephadm 2023-12-07T17:06:08.636210+0000 mgr.smithi172.nqsqxd (mgr.14199) 16 : cephadm 1 Reconfiguring daemon grafana.smithi172 on smithi172 2023-12-07T17:06:09.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:09 smithi172 bash[24902]: cluster 2023-12-07T17:06:08.974124+0000 mgr.smithi172.nqsqxd (mgr.14199) 17 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:12.319 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:12 smithi172 bash[24902]: cluster 2023-12-07T17:06:10.974592+0000 mgr.smithi172.nqsqxd (mgr.14199) 18 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:14.049 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:14 smithi172 bash[24902]: cluster 2023-12-07T17:06:12.975035+0000 mgr.smithi172.nqsqxd (mgr.14199) 19 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:15.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:15 smithi172 bash[24902]: audit 2023-12-07T17:06:14.273535+0000 mon.smithi172 (mon.0) 216 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T17:06:15.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:15 smithi172 bash[24902]: audit 2023-12-07T17:06:14.278009+0000 mon.smithi172 (mon.0) 217 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T17:06:15.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:15 smithi172 bash[24902]: audit 2023-12-07T17:06:14.278706+0000 mon.smithi172 (mon.0) 218 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:14.269517+0000 mgr.smithi172.nqsqxd (mgr.14199) 20 : audit 0 from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: cluster 2023-12-07T17:06:14.975448+0000 mgr.smithi172.nqsqxd (mgr.14199) 21 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.701856+0000 mon.smithi172 (mon.0) 219 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.707165+0000 mon.smithi172 (mon.0) 220 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.720495+0000 mon.smithi172 (mon.0) 221 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T17:06:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.722384+0000 mon.smithi172 (mon.0) 222 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi172.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T17:06:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.729465+0000 mon.smithi172 (mon.0) 223 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.746792+0000 mon.smithi172 (mon.0) 224 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T17:06:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.750644+0000 mon.smithi172 (mon.0) 225 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T17:06:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.757897+0000 mon.smithi172 (mon.0) 226 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:16 smithi172 bash[24902]: audit 2023-12-07T17:06:15.776670+0000 mon.smithi172 (mon.0) 227 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:06:17.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:17 smithi172 bash[24902]: audit 2023-12-07T17:06:15.721085+0000 mgr.smithi172.nqsqxd (mgr.14199) 22 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2023-12-07T17:06:17.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:17 smithi172 bash[24902]: audit 2023-12-07T17:06:15.722961+0000 mgr.smithi172.nqsqxd (mgr.14199) 23 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi172.front.sepia.ceph.com:9093"}]: dispatch 2023-12-07T17:06:17.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:17 smithi172 bash[24902]: audit 2023-12-07T17:06:15.747313+0000 mgr.smithi172.nqsqxd (mgr.14199) 24 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2023-12-07T17:06:17.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:17 smithi172 bash[24902]: audit 2023-12-07T17:06:15.751104+0000 mgr.smithi172.nqsqxd (mgr.14199) 25 : audit 0 from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi172.front.sepia.ceph.com:3000"}]: dispatch 2023-12-07T17:06:18.321 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:18 smithi172 bash[24902]: cluster 2023-12-07T17:06:16.975850+0000 mgr.smithi172.nqsqxd (mgr.14199) 26 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:20.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:20 smithi172 bash[24902]: cluster 2023-12-07T17:06:18.976260+0000 mgr.smithi172.nqsqxd (mgr.14199) 27 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:20.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:20 smithi172 bash[24902]: audit 2023-12-07T17:06:19.068008+0000 mon.smithi172 (mon.0) 228 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:06:22.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:22 smithi172 bash[24902]: cluster 2023-12-07T17:06:20.976737+0000 mgr.smithi172.nqsqxd (mgr.14199) 28 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: cluster 2023-12-07T17:06:22.977033+0000 mgr.smithi172.nqsqxd (mgr.14199) 29 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.016371+0000 mon.smithi172 (mon.0) 229 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.022002+0000 mon.smithi172 (mon.0) 230 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.023400+0000 mon.smithi172 (mon.0) 231 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.024650+0000 mon.smithi172 (mon.0) 232 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.030174+0000 mon.smithi172 (mon.0) 233 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.220190+0000 mon.smithi172 (mon.0) 234 : audit 1 from='client.? 172.21.15.172:0/960595747' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "213ee991-6535-49e3-bfc8-941445340d7b"}]: dispatch 2023-12-07T17:06:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.222221+0000 mon.smithi172 (mon.0) 235 : audit 1 from='client.? 172.21.15.172:0/960595747' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "213ee991-6535-49e3-bfc8-941445340d7b"}]': finished 2023-12-07T17:06:24.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: cluster 2023-12-07T17:06:23.226764+0000 mon.smithi172 (mon.0) 236 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2023-12-07T17:06:24.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.227123+0000 mon.smithi172 (mon.0) 237 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T17:06:24.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:24 smithi172 bash[24902]: audit 2023-12-07T17:06:23.951878+0000 mon.smithi172 (mon.0) 238 : audit 0 from='client.? 172.21.15.172:0/2916247960' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T17:06:26.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:26 smithi172 bash[24902]: cluster 2023-12-07T17:06:24.977468+0000 mgr.smithi172.nqsqxd (mgr.14199) 30 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:27.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:27 smithi172 bash[24902]: cluster 2023-12-07T17:06:26.978032+0000 mgr.smithi172.nqsqxd (mgr.14199) 31 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:30.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:30 smithi172 bash[24902]: cluster 2023-12-07T17:06:28.978437+0000 mgr.smithi172.nqsqxd (mgr.14199) 32 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:32.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:32 smithi172 bash[24902]: cluster 2023-12-07T17:06:30.978869+0000 mgr.smithi172.nqsqxd (mgr.14199) 33 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:34.355 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:34 smithi172 bash[24902]: cluster 2023-12-07T17:06:32.979387+0000 mgr.smithi172.nqsqxd (mgr.14199) 34 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:35.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:35 smithi172 bash[24902]: audit 2023-12-07T17:06:34.068287+0000 mon.smithi172 (mon.0) 239 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:06:36.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:36 smithi172 bash[24902]: cluster 2023-12-07T17:06:34.979899+0000 mgr.smithi172.nqsqxd (mgr.14199) 35 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:37.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:37 smithi172 bash[24902]: audit 2023-12-07T17:06:36.585163+0000 mon.smithi172 (mon.0) 240 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-07T17:06:37.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:37 smithi172 bash[24902]: audit 2023-12-07T17:06:36.586441+0000 mon.smithi172 (mon.0) 241 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:06:37.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:37 smithi172 bash[24902]: cephadm 2023-12-07T17:06:36.587534+0000 mgr.smithi172.nqsqxd (mgr.14199) 36 : cephadm 1 Deploying daemon osd.0 on smithi172 2023-12-07T17:06:37.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:37 smithi172 bash[24902]: cluster 2023-12-07T17:06:36.980331+0000 mgr.smithi172.nqsqxd (mgr.14199) 37 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:40.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:40 smithi172 bash[24902]: cluster 2023-12-07T17:06:38.980794+0000 mgr.smithi172.nqsqxd (mgr.14199) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:42.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:42 smithi172 bash[24902]: cluster 2023-12-07T17:06:40.981275+0000 mgr.smithi172.nqsqxd (mgr.14199) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:42.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:42 smithi172 bash[24902]: audit 2023-12-07T17:06:41.527152+0000 mon.smithi172 (mon.0) 242 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:42.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:42 smithi172 bash[24902]: audit 2023-12-07T17:06:41.534859+0000 mon.smithi172 (mon.0) 243 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:42.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:42 smithi172 bash[24902]: audit 2023-12-07T17:06:41.540366+0000 mon.smithi172 (mon.0) 244 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:06:44.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:44 smithi172 bash[24902]: cluster 2023-12-07T17:06:42.981671+0000 mgr.smithi172.nqsqxd (mgr.14199) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:46.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:46 smithi172 bash[24902]: cluster 2023-12-07T17:06:44.982021+0000 mgr.smithi172.nqsqxd (mgr.14199) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:47.590 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:47 smithi172 bash[24902]: cluster 2023-12-07T17:06:46.982566+0000 mgr.smithi172.nqsqxd (mgr.14199) 42 : cluster 0 pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:49.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:47.879518+0000 mon.smithi172 (mon.0) 245 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:49.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:47.884430+0000 mon.smithi172 (mon.0) 246 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:49.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:47.885912+0000 mon.smithi172 (mon.0) 247 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:06:49.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:47.887140+0000 mon.smithi172 (mon.0) 248 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:06:49.288 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:47.892058+0000 mon.smithi172 (mon.0) 249 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:49.288 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:48 smithi172 bash[24902]: audit 2023-12-07T17:06:48.541681+0000 mon.smithi172 (mon.0) 250 : audit 1 from='osd.0 [v2:172.21.15.172:6802/460654906,v1:172.21.15.172:6803/460654906]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-07T17:06:50.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: audit 2023-12-07T17:06:48.891790+0000 mon.smithi172 (mon.0) 251 : audit 1 from='osd.0 [v2:172.21.15.172:6802/460654906,v1:172.21.15.172:6803/460654906]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-07T17:06:50.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: cluster 2023-12-07T17:06:48.895877+0000 mon.smithi172 (mon.0) 252 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2023-12-07T17:06:50.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: audit 2023-12-07T17:06:48.896380+0000 mon.smithi172 (mon.0) 253 : audit 1 from='osd.0 [v2:172.21.15.172:6802/460654906,v1:172.21.15.172:6803/460654906]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-12-07T17:06:50.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: audit 2023-12-07T17:06:48.896841+0000 mon.smithi172 (mon.0) 254 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T17:06:50.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: cluster 2023-12-07T17:06:48.982951+0000 mgr.smithi172.nqsqxd (mgr.14199) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-07T17:06:50.210 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:49 smithi172 bash[24902]: audit 2023-12-07T17:06:49.068629+0000 mon.smithi172 (mon.0) 255 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:06:50.789 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 0 on host 'smithi172' 2023-12-07T17:06:51.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:49.897567+0000 mon.smithi172 (mon.0) 256 : audit 1 from='osd.0 [v2:172.21.15.172:6802/460654906,v1:172.21.15.172:6803/460654906]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-12-07T17:06:51.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: cluster 2023-12-07T17:06:49.902909+0000 mon.smithi172 (mon.0) 257 : cluster 0 osdmap e8: 1 total, 0 up, 1 in 2023-12-07T17:06:51.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:49.903866+0000 mon.smithi172 (mon.0) 258 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T17:06:51.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:49.908848+0000 mon.smithi172 (mon.0) 259 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T17:06:51.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:50.781225+0000 mon.smithi172 (mon.0) 260 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:51.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:50.788976+0000 mon.smithi172 (mon.0) 261 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:51.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:50 smithi172 bash[24902]: audit 2023-12-07T17:06:50.815279+0000 mon.smithi172 (mon.0) 262 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:06:51.520 DEBUG:teuthology.orchestra.run.smithi172:osd.0> sudo journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.0.service 2023-12-07T17:06:51.522 INFO:tasks.cephadm:Deploying osd.1 on smithi172 with /dev/vg_nvme/lv_3... 2023-12-07T17:06:51.523 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-07T17:06:51.661 INFO:journalctl@ceph.osd.0.smithi172.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: cluster 2023-12-07T17:06:49.572257+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: cluster 2023-12-07T17:06:49.572371+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: cluster 2023-12-07T17:06:50.901911+0000 mon.smithi172 (mon.0) 263 : cluster 1 osd.0 [v2:172.21.15.172:6802/460654906,v1:172.21.15.172:6803/460654906] boot 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: cluster 2023-12-07T17:06:50.901948+0000 mon.smithi172 (mon.0) 264 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: audit 2023-12-07T17:06:50.902653+0000 mon.smithi172 (mon.0) 265 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-07T17:06:52.286 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:51 smithi172 bash[24902]: cluster 2023-12-07T17:06:50.983291+0000 mgr.smithi172.nqsqxd (mgr.14199) 44 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:06:53.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:53 smithi172 bash[24902]: cluster 2023-12-07T17:06:52.327951+0000 mon.smithi172 (mon.0) 266 : cluster 0 osdmap e10: 1 total, 1 up, 1 in 2023-12-07T17:06:53.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:53 smithi172 bash[24902]: cluster 2023-12-07T17:06:52.983838+0000 mgr.smithi172.nqsqxd (mgr.14199) 45 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:06:55.799 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:06:56.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:56 smithi172 bash[24902]: cluster 2023-12-07T17:06:54.984373+0000 mgr.smithi172.nqsqxd (mgr.14199) 46 : cluster 0 pgmap v31: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:06:57.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:57 smithi172 bash[24902]: cluster 2023-12-07T17:06:56.984760+0000 mgr.smithi172.nqsqxd (mgr.14199) 47 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:06:57.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:57 smithi172 bash[24902]: audit 2023-12-07T17:06:57.203952+0000 mon.smithi172 (mon.0) 267 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:57.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:06:57 smithi172 bash[24902]: audit 2023-12-07T17:06:57.210622+0000 mon.smithi172 (mon.0) 268 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0175502 s, 597 MB/s 2023-12-07T17:06:59.303 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-12-07T17:07:00.124 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_3 2023-12-07T17:07:00.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:00 smithi172 bash[24902]: cluster 2023-12-07T17:06:58.985197+0000 mgr.smithi172.nqsqxd (mgr.14199) 48 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:02.350 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:02 smithi172 bash[24902]: cluster 2023-12-07T17:07:00.985653+0000 mgr.smithi172.nqsqxd (mgr.14199) 49 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:04.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:04 smithi172 bash[24902]: cluster 2023-12-07T17:07:02.986062+0000 mgr.smithi172.nqsqxd (mgr.14199) 50 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:04.948 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:07:05.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:05 smithi172 bash[24902]: audit 2023-12-07T17:07:04.069281+0000 mon.smithi172 (mon.0) 269 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:07:06.211 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:06 smithi172 bash[24902]: cluster 2023-12-07T17:07:04.986504+0000 mgr.smithi172.nqsqxd (mgr.14199) 51 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:07.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:07 smithi172 bash[24902]: cluster 2023-12-07T17:07:06.986813+0000 mgr.smithi172.nqsqxd (mgr.14199) 52 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: cephadm 2023-12-07T17:07:08.672170+0000 mgr.smithi172.nqsqxd (mgr.14199) 53 : cephadm 1 Detected new or changed devices on smithi172 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.679870+0000 mon.smithi172 (mon.0) 270 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.688010+0000 mon.smithi172 (mon.0) 271 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.689777+0000 mon.smithi172 (mon.0) 272 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: cephadm 2023-12-07T17:07:08.690644+0000 mgr.smithi172.nqsqxd (mgr.14199) 54 : cephadm 1 Adjusting osd_memory_target on smithi172 to 7921M 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.694173+0000 mon.smithi172 (mon.0) 273 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.696845+0000 mon.smithi172 (mon.0) 274 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.698246+0000 mon.smithi172 (mon.0) 275 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:08.704608+0000 mon.smithi172 (mon.0) 276 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:10.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: cluster 2023-12-07T17:07:08.987091+0000 mgr.smithi172.nqsqxd (mgr.14199) 55 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:10.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:09.091660+0000 mgr.smithi172.nqsqxd (mgr.14199) 56 : audit 0 from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:07:10.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:09.098335+0000 mon.smithi172 (mon.0) 277 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T17:07:10.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:09.103320+0000 mon.smithi172 (mon.0) 278 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T17:07:10.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:09 smithi172 bash[24902]: audit 2023-12-07T17:07:09.104599+0000 mon.smithi172 (mon.0) 279 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:07:12.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:12 smithi172 bash[24902]: cluster 2023-12-07T17:07:10.987482+0000 mgr.smithi172.nqsqxd (mgr.14199) 57 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:14.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:14 smithi172 bash[24902]: cluster 2023-12-07T17:07:12.987949+0000 mgr.smithi172.nqsqxd (mgr.14199) 58 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:16.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:16 smithi172 bash[24902]: cluster 2023-12-07T17:07:14.988353+0000 mgr.smithi172.nqsqxd (mgr.14199) 59 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:17.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:17 smithi172 bash[24902]: cluster 2023-12-07T17:07:16.988811+0000 mgr.smithi172.nqsqxd (mgr.14199) 60 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:18.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:18 smithi172 bash[24902]: audit 2023-12-07T17:07:17.786437+0000 mon.smithi172 (mon.0) 280 : audit 1 from='client.? 172.21.15.172:0/2489120333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d21a2906-5ca8-4fd5-810d-618d67d7dd7c"}]: dispatch 2023-12-07T17:07:18.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:18 smithi172 bash[24902]: audit 2023-12-07T17:07:17.789051+0000 mon.smithi172 (mon.0) 281 : audit 1 from='client.? 172.21.15.172:0/2489120333' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d21a2906-5ca8-4fd5-810d-618d67d7dd7c"}]': finished 2023-12-07T17:07:18.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:18 smithi172 bash[24902]: cluster 2023-12-07T17:07:17.793258+0000 mon.smithi172 (mon.0) 282 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2023-12-07T17:07:18.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:18 smithi172 bash[24902]: audit 2023-12-07T17:07:17.793537+0000 mon.smithi172 (mon.0) 283 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:19.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:19 smithi172 bash[24902]: audit 2023-12-07T17:07:18.587822+0000 mon.smithi172 (mon.0) 284 : audit 0 from='client.? 172.21.15.172:0/3819385718' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T17:07:19.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:19 smithi172 bash[24902]: cluster 2023-12-07T17:07:18.989292+0000 mgr.smithi172.nqsqxd (mgr.14199) 61 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:19.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:19 smithi172 bash[24902]: audit 2023-12-07T17:07:19.069894+0000 mon.smithi172 (mon.0) 285 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:07:22.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:22 smithi172 bash[24902]: cluster 2023-12-07T17:07:20.989723+0000 mgr.smithi172.nqsqxd (mgr.14199) 62 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:24.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:24 smithi172 bash[24902]: cluster 2023-12-07T17:07:22.990178+0000 mgr.smithi172.nqsqxd (mgr.14199) 63 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:26.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:26 smithi172 bash[24902]: cluster 2023-12-07T17:07:24.990667+0000 mgr.smithi172.nqsqxd (mgr.14199) 64 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:27.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:27 smithi172 bash[24902]: cluster 2023-12-07T17:07:26.991181+0000 mgr.smithi172.nqsqxd (mgr.14199) 65 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:30.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:30 smithi172 bash[24902]: cluster 2023-12-07T17:07:28.991593+0000 mgr.smithi172.nqsqxd (mgr.14199) 66 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:31.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:31 smithi172 bash[24902]: audit 2023-12-07T17:07:30.645436+0000 mon.smithi172 (mon.0) 286 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-07T17:07:31.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:31 smithi172 bash[24902]: audit 2023-12-07T17:07:30.646622+0000 mon.smithi172 (mon.0) 287 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:07:32.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:32 smithi172 bash[24902]: cephadm 2023-12-07T17:07:30.647705+0000 mgr.smithi172.nqsqxd (mgr.14199) 67 : cephadm 1 Deploying daemon osd.1 on smithi172 2023-12-07T17:07:32.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:32 smithi172 bash[24902]: cluster 2023-12-07T17:07:30.992086+0000 mgr.smithi172.nqsqxd (mgr.14199) 68 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:34.122 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:34 smithi172 bash[24902]: cluster 2023-12-07T17:07:32.992508+0000 mgr.smithi172.nqsqxd (mgr.14199) 69 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:35.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:35 smithi172 bash[24902]: audit 2023-12-07T17:07:34.069902+0000 mon.smithi172 (mon.0) 288 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:07:36.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:36 smithi172 bash[24902]: cluster 2023-12-07T17:07:34.992976+0000 mgr.smithi172.nqsqxd (mgr.14199) 70 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:36.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:36 smithi172 bash[24902]: audit 2023-12-07T17:07:35.693463+0000 mon.smithi172 (mon.0) 289 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:36.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:36 smithi172 bash[24902]: audit 2023-12-07T17:07:35.699056+0000 mon.smithi172 (mon.0) 290 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:36.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:36 smithi172 bash[24902]: audit 2023-12-07T17:07:35.733168+0000 mon.smithi172 (mon.0) 291 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:07:37.535 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:37 smithi172 bash[24902]: cluster 2023-12-07T17:07:36.993417+0000 mgr.smithi172.nqsqxd (mgr.14199) 71 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:40.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:40 smithi172 bash[24902]: cluster 2023-12-07T17:07:38.993905+0000 mgr.smithi172.nqsqxd (mgr.14199) 72 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:42.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:42 smithi172 bash[24902]: cluster 2023-12-07T17:07:40.994318+0000 mgr.smithi172.nqsqxd (mgr.14199) 73 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.073818+0000 mon.smithi172 (mon.0) 292 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.080003+0000 mon.smithi172 (mon.0) 293 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.081564+0000 mon.smithi172 (mon.0) 294 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.082600+0000 mon.smithi172 (mon.0) 295 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.087582+0000 mon.smithi172 (mon.0) 296 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:43.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:43 smithi172 bash[24902]: audit 2023-12-07T17:07:42.676818+0000 mon.smithi172 (mon.0) 297 : audit 1 from='osd.1 [v2:172.21.15.172:6810/3382766665,v1:172.21.15.172:6811/3382766665]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-07T17:07:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:44 smithi172 bash[24902]: cluster 2023-12-07T17:07:42.994749+0000 mgr.smithi172.nqsqxd (mgr.14199) 74 : cluster 0 pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:44 smithi172 bash[24902]: audit 2023-12-07T17:07:43.090403+0000 mon.smithi172 (mon.0) 298 : audit 1 from='osd.1 [v2:172.21.15.172:6810/3382766665,v1:172.21.15.172:6811/3382766665]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-07T17:07:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:44 smithi172 bash[24902]: cluster 2023-12-07T17:07:43.094548+0000 mon.smithi172 (mon.0) 299 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2023-12-07T17:07:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:44 smithi172 bash[24902]: audit 2023-12-07T17:07:43.095028+0000 mon.smithi172 (mon.0) 300 : audit 1 from='osd.1 [v2:172.21.15.172:6810/3382766665,v1:172.21.15.172:6811/3382766665]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-12-07T17:07:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:44 smithi172 bash[24902]: audit 2023-12-07T17:07:43.095573+0000 mon.smithi172 (mon.0) 301 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:44.956 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 1 on host 'smithi172' 2023-12-07T17:07:45.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.091578+0000 mon.smithi172 (mon.0) 302 : audit 1 from='osd.1 [v2:172.21.15.172:6810/3382766665,v1:172.21.15.172:6811/3382766665]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: cluster 2023-12-07T17:07:44.096869+0000 mon.smithi172 (mon.0) 303 : cluster 0 osdmap e13: 2 total, 1 up, 2 in 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.101707+0000 mon.smithi172 (mon.0) 304 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.107329+0000 mon.smithi172 (mon.0) 305 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.937382+0000 mon.smithi172 (mon.0) 306 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.943187+0000 mon.smithi172 (mon.0) 307 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:45.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:45 smithi172 bash[24902]: audit 2023-12-07T17:07:44.951334+0000 mon.smithi172 (mon.0) 308 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:07:45.670 DEBUG:teuthology.orchestra.run.smithi172:osd.1> sudo journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.1.service 2023-12-07T17:07:45.672 INFO:tasks.cephadm:Deploying osd.2 on smithi172 with /dev/vg_nvme/lv_2... 2023-12-07T17:07:45.672 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-07T17:07:45.914 INFO:journalctl@ceph.osd.1.smithi172.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-12-07T17:07:46.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: cluster 2023-12-07T17:07:43.720452+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: cluster 2023-12-07T17:07:43.720577+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: cluster 2023-12-07T17:07:44.995169+0000 mgr.smithi172.nqsqxd (mgr.14199) 75 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: audit 2023-12-07T17:07:45.107113+0000 mon.smithi172 (mon.0) 309 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: cluster 2023-12-07T17:07:45.112230+0000 mon.smithi172 (mon.0) 310 : cluster 1 osd.1 [v2:172.21.15.172:6810/3382766665,v1:172.21.15.172:6811/3382766665] boot 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: cluster 2023-12-07T17:07:45.112260+0000 mon.smithi172 (mon.0) 311 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2023-12-07T17:07:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:46 smithi172 bash[24902]: audit 2023-12-07T17:07:45.112545+0000 mon.smithi172 (mon.0) 312 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-07T17:07:47.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:47 smithi172 bash[24902]: cluster 2023-12-07T17:07:46.118670+0000 mon.smithi172 (mon.0) 313 : cluster 0 osdmap e15: 2 total, 2 up, 2 in 2023-12-07T17:07:47.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:47 smithi172 bash[24902]: audit 2023-12-07T17:07:47.111382+0000 mon.smithi172 (mon.0) 314 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-07T17:07:48.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:48 smithi172 bash[24902]: cluster 2023-12-07T17:07:46.995667+0000 mgr.smithi172.nqsqxd (mgr.14199) 76 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:07:48.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:48 smithi172 bash[24902]: audit 2023-12-07T17:07:47.595470+0000 mon.smithi172 (mon.0) 315 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-07T17:07:48.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:48 smithi172 bash[24902]: cluster 2023-12-07T17:07:47.601136+0000 mon.smithi172 (mon.0) 316 : cluster 0 osdmap e16: 2 total, 2 up, 2 in 2023-12-07T17:07:48.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:48 smithi172 bash[24902]: audit 2023-12-07T17:07:47.602654+0000 mon.smithi172 (mon.0) 317 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-07T17:07:49.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:49 smithi172 bash[24902]: audit 2023-12-07T17:07:48.598874+0000 mon.smithi172 (mon.0) 318 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-07T17:07:49.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:49 smithi172 bash[24902]: cluster 2023-12-07T17:07:48.604922+0000 mon.smithi172 (mon.0) 319 : cluster 0 osdmap e17: 2 total, 2 up, 2 in 2023-12-07T17:07:49.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:49 smithi172 bash[24902]: cluster 2023-12-07T17:07:48.996182+0000 mgr.smithi172.nqsqxd (mgr.14199) 77 : cluster 0 pgmap v65: 1 pgs: 1 unknown; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:07:49.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:49 smithi172 bash[24902]: audit 2023-12-07T17:07:49.070501+0000 mon.smithi172 (mon.0) 320 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:07:49.951 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:07:50.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:50 smithi172 bash[24902]: cluster 2023-12-07T17:07:49.616557+0000 mon.smithi172 (mon.0) 321 : cluster 0 osdmap e18: 2 total, 2 up, 2 in 2023-12-07T17:07:50.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:50 smithi172 bash[24902]: audit 2023-12-07T17:07:50.439199+0000 mon.smithi172 (mon.0) 322 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:52.372 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:52 smithi172 bash[24902]: cluster 2023-12-07T17:07:50.621227+0000 mon.smithi172 (mon.0) 323 : cluster 0 mgrmap e19: smithi172.nqsqxd(active, since 2m), standbys: smithi172.occzht 2023-12-07T17:07:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:52 smithi172 bash[24902]: cluster 2023-12-07T17:07:50.996686+0000 mgr.smithi172.nqsqxd (mgr.14199) 78 : cluster 0 pgmap v67: 1 pgs: 1 unknown; 0 B data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:07:53.622 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:53 smithi172 bash[24902]: audit 2023-12-07T17:07:51.358213+0000 mon.smithi172 (mon.0) 324 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-07T17:07:53.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:53 smithi172 bash[24902]: audit 2023-12-07T17:07:52.248474+0000 mon.smithi172 (mon.0) 325 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-07T17:07:53.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:53 smithi172 bash[24902]: audit 2023-12-07T17:07:52.248803+0000 mon.smithi172 (mon.0) 326 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "mon metadata", "id": "smithi172"}]: dispatch 2023-12-07T17:07:53.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:53 smithi172 bash[24902]: cluster 2023-12-07T17:07:52.997229+0000 mgr.smithi172.nqsqxd (mgr.14199) 79 : cluster 0 pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:07:55.137 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-07T17:07:55.137 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-07T17:07:55.137 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-12-07T17:07:55.138 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-12-07T17:07:55.138 INFO:teuthology.orchestra.run.smithi172.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0163225 s, 642 MB/s 2023-12-07T17:07:55.138 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-12-07T17:07:55.903 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_2 2023-12-07T17:07:56.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:56 smithi172 bash[24902]: cluster 2023-12-07T17:07:54.997608+0000 mgr.smithi172.nqsqxd (mgr.14199) 80 : cluster 0 pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:07:58.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: cephadm 2023-12-07T17:07:56.649309+0000 mgr.smithi172.nqsqxd (mgr.14199) 81 : cephadm 1 Detected new or changed devices on smithi172 2023-12-07T17:07:58.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.656882+0000 mon.smithi172 (mon.0) 327 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.664537+0000 mon.smithi172 (mon.0) 328 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.666847+0000 mon.smithi172 (mon.0) 329 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.668138+0000 mon.smithi172 (mon.0) 330 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: cephadm 2023-12-07T17:07:56.669158+0000 mgr.smithi172.nqsqxd (mgr.14199) 82 : cephadm 1 Adjusting osd_memory_target on smithi172 to 3960M 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.672256+0000 mon.smithi172 (mon.0) 331 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.675047+0000 mon.smithi172 (mon.0) 332 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:07:58.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.676518+0000 mon.smithi172 (mon.0) 333 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:07:58.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: audit 2023-12-07T17:07:56.682348+0000 mon.smithi172 (mon.0) 334 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:07:58.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:07:57 smithi172 bash[24902]: cluster 2023-12-07T17:07:56.998147+0000 mgr.smithi172.nqsqxd (mgr.14199) 83 : cluster 0 pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 2.2 KiB/s rd, 65 KiB/s wr, 5 op/s 2023-12-07T17:08:00.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:00 smithi172 bash[24902]: cluster 2023-12-07T17:07:58.998827+0000 mgr.smithi172.nqsqxd (mgr.14199) 84 : cluster 0 pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-07T17:08:00.676 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:08:02.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:02 smithi172 bash[24902]: cluster 2023-12-07T17:08:00.999523+0000 mgr.smithi172.nqsqxd (mgr.14199) 85 : cluster 0 pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-07T17:08:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:04 smithi172 bash[24902]: cluster 2023-12-07T17:08:02.999961+0000 mgr.smithi172.nqsqxd (mgr.14199) 86 : cluster 0 pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-07T17:08:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:04 smithi172 bash[24902]: audit 2023-12-07T17:08:03.876086+0000 mon.smithi172 (mon.0) 335 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T17:08:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:04 smithi172 bash[24902]: audit 2023-12-07T17:08:03.882015+0000 mon.smithi172 (mon.0) 336 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T17:08:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:04 smithi172 bash[24902]: audit 2023-12-07T17:08:03.883142+0000 mon.smithi172 (mon.0) 337 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:08:05.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:05 smithi172 bash[24902]: audit 2023-12-07T17:08:03.869452+0000 mgr.smithi172.nqsqxd (mgr.14199) 87 : audit 0 from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:08:05.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:05 smithi172 bash[24902]: audit 2023-12-07T17:08:04.070852+0000 mon.smithi172 (mon.0) 338 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:08:06.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:06 smithi172 bash[24902]: cluster 2023-12-07T17:08:05.000545+0000 mgr.smithi172.nqsqxd (mgr.14199) 88 : cluster 0 pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-07T17:08:07.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:07 smithi172 bash[24902]: cluster 2023-12-07T17:08:07.001250+0000 mgr.smithi172.nqsqxd (mgr.14199) 89 : cluster 0 pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-07T17:08:10.305 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:10 smithi172 bash[24902]: cluster 2023-12-07T17:08:09.001656+0000 mgr.smithi172.nqsqxd (mgr.14199) 90 : cluster 0 pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:12.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:12 smithi172 bash[24902]: cluster 2023-12-07T17:08:11.002158+0000 mgr.smithi172.nqsqxd (mgr.14199) 91 : cluster 0 pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:13.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:13 smithi172 bash[24902]: audit 2023-12-07T17:08:12.693703+0000 mon.smithi172 (mon.0) 339 : audit 1 from='client.? 172.21.15.172:0/1054148931' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ef19ec0-7065-4d01-ba15-9c3fac98e483"}]: dispatch 2023-12-07T17:08:13.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:13 smithi172 bash[24902]: audit 2023-12-07T17:08:12.695737+0000 mon.smithi172 (mon.0) 340 : audit 1 from='client.? 172.21.15.172:0/1054148931' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ef19ec0-7065-4d01-ba15-9c3fac98e483"}]': finished 2023-12-07T17:08:13.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:13 smithi172 bash[24902]: cluster 2023-12-07T17:08:12.700558+0000 mon.smithi172 (mon.0) 341 : cluster 0 osdmap e19: 3 total, 2 up, 3 in 2023-12-07T17:08:13.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:13 smithi172 bash[24902]: audit 2023-12-07T17:08:12.700929+0000 mon.smithi172 (mon.0) 342 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T17:08:14.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:14 smithi172 bash[24902]: cluster 2023-12-07T17:08:13.002674+0000 mgr.smithi172.nqsqxd (mgr.14199) 92 : cluster 0 pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:14.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:14 smithi172 bash[24902]: audit 2023-12-07T17:08:13.446187+0000 mon.smithi172 (mon.0) 343 : audit 0 from='client.? 172.21.15.172:0/4048588591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T17:08:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:16 smithi172 bash[24902]: cluster 2023-12-07T17:08:15.003155+0000 mgr.smithi172.nqsqxd (mgr.14199) 93 : cluster 0 pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 55 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:17.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:17 smithi172 bash[24902]: cluster 2023-12-07T17:08:17.003655+0000 mgr.smithi172.nqsqxd (mgr.14199) 94 : cluster 0 pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:20.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:20 smithi172 bash[24902]: cluster 2023-12-07T17:08:19.004163+0000 mgr.smithi172.nqsqxd (mgr.14199) 95 : cluster 0 pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:20.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:20 smithi172 bash[24902]: audit 2023-12-07T17:08:19.071307+0000 mon.smithi172 (mon.0) 344 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:08:22.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:22 smithi172 bash[24902]: cluster 2023-12-07T17:08:21.004793+0000 mgr.smithi172.nqsqxd (mgr.14199) 96 : cluster 0 pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:24.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:24 smithi172 bash[24902]: cluster 2023-12-07T17:08:23.005315+0000 mgr.smithi172.nqsqxd (mgr.14199) 97 : cluster 0 pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:26.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:26 smithi172 bash[24902]: cluster 2023-12-07T17:08:25.005914+0000 mgr.smithi172.nqsqxd (mgr.14199) 98 : cluster 0 pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:26.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:26 smithi172 bash[24902]: audit 2023-12-07T17:08:25.694768+0000 mon.smithi172 (mon.0) 345 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-07T17:08:26.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:26 smithi172 bash[24902]: audit 2023-12-07T17:08:25.696379+0000 mon.smithi172 (mon.0) 346 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:08:27.274 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:27 smithi172 bash[24902]: cephadm 2023-12-07T17:08:25.697324+0000 mgr.smithi172.nqsqxd (mgr.14199) 99 : cephadm 1 Deploying daemon osd.2 on smithi172 2023-12-07T17:08:28.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:28 smithi172 bash[24902]: cluster 2023-12-07T17:08:27.006556+0000 mgr.smithi172.nqsqxd (mgr.14199) 100 : cluster 0 pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:30.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:30 smithi172 bash[24902]: cluster 2023-12-07T17:08:29.006892+0000 mgr.smithi172.nqsqxd (mgr.14199) 101 : cluster 0 pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:31.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:31 smithi172 bash[24902]: audit 2023-12-07T17:08:30.440356+0000 mon.smithi172 (mon.0) 347 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:31.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:31 smithi172 bash[24902]: audit 2023-12-07T17:08:30.446041+0000 mon.smithi172 (mon.0) 348 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:31.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:31 smithi172 bash[24902]: audit 2023-12-07T17:08:30.476777+0000 mon.smithi172 (mon.0) 349 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:08:31.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:31 smithi172 bash[24902]: cluster 2023-12-07T17:08:31.007267+0000 mgr.smithi172.nqsqxd (mgr.14199) 102 : cluster 0 pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:34.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:34 smithi172 bash[24902]: cluster 2023-12-07T17:08:33.007768+0000 mgr.smithi172.nqsqxd (mgr.14199) 103 : cluster 0 pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:35.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:35 smithi172 bash[24902]: audit 2023-12-07T17:08:34.071190+0000 mon.smithi172 (mon.0) 350 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:08:36.316 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:36 smithi172 bash[24902]: cluster 2023-12-07T17:08:35.008226+0000 mgr.smithi172.nqsqxd (mgr.14199) 104 : cluster 0 pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:38.192 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:36.916797+0000 mon.smithi172 (mon.0) 351 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:36.922862+0000 mon.smithi172 (mon.0) 352 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: cluster 2023-12-07T17:08:37.008695+0000 mgr.smithi172.nqsqxd (mgr.14199) 105 : cluster 0 pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:37.248621+0000 mon.smithi172 (mon.0) 353 : audit 1 from='osd.2 [v2:172.21.15.172:6818/607648447,v1:172.21.15.172:6819/607648447]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:37.495002+0000 mon.smithi172 (mon.0) 354 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:37.496361+0000 mon.smithi172 (mon.0) 355 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:08:38.193 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:37 smithi172 bash[24902]: audit 2023-12-07T17:08:37.502592+0000 mon.smithi172 (mon.0) 356 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:39.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:38 smithi172 bash[24902]: audit 2023-12-07T17:08:37.921898+0000 mon.smithi172 (mon.0) 357 : audit 1 from='osd.2 [v2:172.21.15.172:6818/607648447,v1:172.21.15.172:6819/607648447]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-07T17:08:39.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:38 smithi172 bash[24902]: cluster 2023-12-07T17:08:37.924855+0000 mon.smithi172 (mon.0) 358 : cluster 0 osdmap e20: 3 total, 2 up, 3 in 2023-12-07T17:08:39.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:38 smithi172 bash[24902]: audit 2023-12-07T17:08:37.925492+0000 mon.smithi172 (mon.0) 359 : audit 1 from='osd.2 [v2:172.21.15.172:6818/607648447,v1:172.21.15.172:6819/607648447]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-12-07T17:08:39.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:38 smithi172 bash[24902]: audit 2023-12-07T17:08:37.925846+0000 mon.smithi172 (mon.0) 360 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T17:08:39.586 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 2 on host 'smithi172' 2023-12-07T17:08:40.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:38.923193+0000 mon.smithi172 (mon.0) 361 : audit 1 from='osd.2 [v2:172.21.15.172:6818/607648447,v1:172.21.15.172:6819/607648447]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-12-07T17:08:40.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: cluster 2023-12-07T17:08:38.928500+0000 mon.smithi172 (mon.0) 362 : cluster 0 osdmap e21: 3 total, 2 up, 3 in 2023-12-07T17:08:40.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:38.933370+0000 mon.smithi172 (mon.0) 363 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T17:08:40.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:38.934371+0000 mon.smithi172 (mon.0) 364 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T17:08:40.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: cluster 2023-12-07T17:08:39.009215+0000 mgr.smithi172.nqsqxd (mgr.14199) 106 : cluster 0 pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 54 MiB used, 179 GiB / 179 GiB avail 2023-12-07T17:08:40.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:39.568076+0000 mon.smithi172 (mon.0) 365 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:40.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:39.568537+0000 mon.smithi172 (mon.0) 366 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:08:40.124 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:39 smithi172 bash[24902]: audit 2023-12-07T17:08:39.575621+0000 mon.smithi172 (mon.0) 367 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:40.229 DEBUG:teuthology.orchestra.run.smithi172:osd.2> sudo journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.2.service 2023-12-07T17:08:40.232 INFO:tasks.cephadm:Deploying osd.3 on smithi172 with /dev/vg_nvme/lv_1... 2023-12-07T17:08:40.232 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-07T17:08:40.507 INFO:journalctl@ceph.osd.2.smithi172.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-12-07T17:08:41.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:40 smithi172 bash[24902]: cluster 2023-12-07T17:08:38.207267+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2023-12-07T17:08:41.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:40 smithi172 bash[24902]: cluster 2023-12-07T17:08:38.207357+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2023-12-07T17:08:41.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:40 smithi172 bash[24902]: cluster 2023-12-07T17:08:39.935115+0000 mon.smithi172 (mon.0) 368 : cluster 1 osd.2 [v2:172.21.15.172:6818/607648447,v1:172.21.15.172:6819/607648447] boot 2023-12-07T17:08:41.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:40 smithi172 bash[24902]: cluster 2023-12-07T17:08:39.935161+0000 mon.smithi172 (mon.0) 369 : cluster 0 osdmap e22: 3 total, 3 up, 3 in 2023-12-07T17:08:41.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:40 smithi172 bash[24902]: audit 2023-12-07T17:08:39.935659+0000 mon.smithi172 (mon.0) 370 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-07T17:08:42.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:41 smithi172 bash[24902]: cluster 2023-12-07T17:08:40.945257+0000 mon.smithi172 (mon.0) 371 : cluster 0 osdmap e23: 3 total, 3 up, 3 in 2023-12-07T17:08:42.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:41 smithi172 bash[24902]: cluster 2023-12-07T17:08:41.009693+0000 mgr.smithi172.nqsqxd (mgr.14199) 107 : cluster 0 pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:44.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:44 smithi172 bash[24902]: cluster 2023-12-07T17:08:43.010290+0000 mgr.smithi172.nqsqxd (mgr.14199) 108 : cluster 0 pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:44.562 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:08:46.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:46 smithi172 bash[24902]: cluster 2023-12-07T17:08:45.010874+0000 mgr.smithi172.nqsqxd (mgr.14199) 109 : cluster 0 pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:47.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:47 smithi172 bash[24902]: cluster 2023-12-07T17:08:47.011491+0000 mgr.smithi172.nqsqxd (mgr.14199) 110 : cluster 0 pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:49.515 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-07T17:08:49.515 INFO:teuthology.orchestra.run.smithi172.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-07T17:08:49.515 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10+0 records in 2023-12-07T17:08:49.515 INFO:teuthology.orchestra.run.smithi172.stderr:10+0 records out 2023-12-07T17:08:49.516 INFO:teuthology.orchestra.run.smithi172.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0156165 s, 671 MB/s 2023-12-07T17:08:49.516 INFO:teuthology.orchestra.run.smithi172.stderr:--> Zapping successful for: 2023-12-07T17:08:50.326 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:50 smithi172 bash[24902]: cluster 2023-12-07T17:08:49.012012+0000 mgr.smithi172.nqsqxd (mgr.14199) 111 : cluster 0 pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:50.326 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:50 smithi172 bash[24902]: audit 2023-12-07T17:08:49.071665+0000 mon.smithi172 (mon.0) 372 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:08:50.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi172:vg_nvme/lv_1 2023-12-07T17:08:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: cluster 2023-12-07T17:08:51.012647+0000 mgr.smithi172.nqsqxd (mgr.14199) 112 : cluster 0 pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: cephadm 2023-12-07T17:08:51.063168+0000 mgr.smithi172.nqsqxd (mgr.14199) 113 : cephadm 1 Detected new or changed devices on smithi172 2023-12-07T17:08:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.075703+0000 mon.smithi172 (mon.0) 373 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.083268+0000 mon.smithi172 (mon.0) 374 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.085445+0000 mon.smithi172 (mon.0) 375 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.086788+0000 mon.smithi172 (mon.0) 376 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.088026+0000 mon.smithi172 (mon.0) 377 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: cephadm 2023-12-07T17:08:51.089017+0000 mgr.smithi172.nqsqxd (mgr.14199) 114 : cephadm 1 Adjusting osd_memory_target on smithi172 to 2640M 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.094780+0000 mon.smithi172 (mon.0) 378 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.097831+0000 mon.smithi172 (mon.0) 379 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.099136+0000 mon.smithi172 (mon.0) 380 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:08:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:52 smithi172 bash[24902]: audit 2023-12-07T17:08:51.104542+0000 mon.smithi172 (mon.0) 381 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:08:54.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:54 smithi172 bash[24902]: cluster 2023-12-07T17:08:53.013200+0000 mgr.smithi172.nqsqxd (mgr.14199) 115 : cluster 0 pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:55.123 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:08:56.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:56 smithi172 bash[24902]: cluster 2023-12-07T17:08:55.013740+0000 mgr.smithi172.nqsqxd (mgr.14199) 116 : cluster 0 pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:57.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:57 smithi172 bash[24902]: cluster 2023-12-07T17:08:57.014229+0000 mgr.smithi172.nqsqxd (mgr.14199) 117 : cluster 0 pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:08:58.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:58 smithi172 bash[24902]: audit 2023-12-07T17:08:58.298289+0000 mon.smithi172 (mon.0) 382 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-07T17:08:58.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:58 smithi172 bash[24902]: audit 2023-12-07T17:08:58.301766+0000 mon.smithi172 (mon.0) 383 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-07T17:08:58.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:58 smithi172 bash[24902]: audit 2023-12-07T17:08:58.303178+0000 mon.smithi172 (mon.0) 384 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:08:59.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:59 smithi172 bash[24902]: audit 2023-12-07T17:08:58.291535+0000 mgr.smithi172.nqsqxd (mgr.14199) 118 : audit 0 from='client.14241 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi172:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:08:59.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:08:59 smithi172 bash[24902]: cluster 2023-12-07T17:08:59.014774+0000 mgr.smithi172.nqsqxd (mgr.14199) 119 : cluster 0 pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:02.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:02 smithi172 bash[24902]: cluster 2023-12-07T17:09:01.015364+0000 mgr.smithi172.nqsqxd (mgr.14199) 120 : cluster 0 pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:04 smithi172 bash[24902]: cluster 2023-12-07T17:09:03.015942+0000 mgr.smithi172.nqsqxd (mgr.14199) 121 : cluster 0 pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:05.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:05 smithi172 bash[24902]: audit 2023-12-07T17:09:04.075758+0000 mon.smithi172 (mon.0) 385 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:09:06.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:06 smithi172 bash[24902]: cluster 2023-12-07T17:09:05.016455+0000 mgr.smithi172.nqsqxd (mgr.14199) 122 : cluster 0 pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:07.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:07 smithi172 bash[24902]: cluster 2023-12-07T17:09:07.016983+0000 mgr.smithi172.nqsqxd (mgr.14199) 123 : cluster 0 pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:07.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:07 smithi172 bash[24902]: audit 2023-12-07T17:09:07.131674+0000 mon.smithi172 (mon.0) 386 : audit 1 from='client.? 172.21.15.172:0/2506298448' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "01d14ba0-0e83-4f3b-ab37-0ef938adf7cc"}]: dispatch 2023-12-07T17:09:07.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:07 smithi172 bash[24902]: audit 2023-12-07T17:09:07.134060+0000 mon.smithi172 (mon.0) 387 : audit 1 from='client.? 172.21.15.172:0/2506298448' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "01d14ba0-0e83-4f3b-ab37-0ef938adf7cc"}]': finished 2023-12-07T17:09:07.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:07 smithi172 bash[24902]: cluster 2023-12-07T17:09:07.138143+0000 mon.smithi172 (mon.0) 388 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2023-12-07T17:09:07.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:07 smithi172 bash[24902]: audit 2023-12-07T17:09:07.138509+0000 mon.smithi172 (mon.0) 389 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T17:09:08.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:08 smithi172 bash[24902]: audit 2023-12-07T17:09:07.879652+0000 mon.smithi172 (mon.0) 390 : audit 0 from='client.? 172.21.15.172:0/1784508407' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-07T17:09:09.873 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:09 smithi172 bash[24902]: cluster 2023-12-07T17:09:09.017424+0000 mgr.smithi172.nqsqxd (mgr.14199) 124 : cluster 0 pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:12.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:12 smithi172 bash[24902]: cluster 2023-12-07T17:09:11.017949+0000 mgr.smithi172.nqsqxd (mgr.14199) 125 : cluster 0 pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:14.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:14 smithi172 bash[24902]: cluster 2023-12-07T17:09:13.018540+0000 mgr.smithi172.nqsqxd (mgr.14199) 126 : cluster 0 pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:16.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:16 smithi172 bash[24902]: cluster 2023-12-07T17:09:15.019016+0000 mgr.smithi172.nqsqxd (mgr.14199) 127 : cluster 0 pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:17.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:17 smithi172 bash[24902]: cluster 2023-12-07T17:09:17.019476+0000 mgr.smithi172.nqsqxd (mgr.14199) 128 : cluster 0 pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:20.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:20 smithi172 bash[24902]: cluster 2023-12-07T17:09:19.019784+0000 mgr.smithi172.nqsqxd (mgr.14199) 129 : cluster 0 pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:20.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:20 smithi172 bash[24902]: audit 2023-12-07T17:09:19.075253+0000 mon.smithi172 (mon.0) 391 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:09:21.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:21 smithi172 bash[24902]: audit 2023-12-07T17:09:20.168462+0000 mon.smithi172 (mon.0) 392 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-07T17:09:21.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:21 smithi172 bash[24902]: audit 2023-12-07T17:09:20.170117+0000 mon.smithi172 (mon.0) 393 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:09:21.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:21 smithi172 bash[24902]: cephadm 2023-12-07T17:09:20.171611+0000 mgr.smithi172.nqsqxd (mgr.14199) 130 : cephadm 1 Deploying daemon osd.3 on smithi172 2023-12-07T17:09:22.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:22 smithi172 bash[24902]: cluster 2023-12-07T17:09:21.020317+0000 mgr.smithi172.nqsqxd (mgr.14199) 131 : cluster 0 pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:24.123 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:24 smithi172 bash[24902]: cluster 2023-12-07T17:09:23.020720+0000 mgr.smithi172.nqsqxd (mgr.14199) 132 : cluster 0 pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:26.366 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:26 smithi172 bash[24902]: cluster 2023-12-07T17:09:25.021058+0000 mgr.smithi172.nqsqxd (mgr.14199) 133 : cluster 0 pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:26.367 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:26 smithi172 bash[24902]: audit 2023-12-07T17:09:25.304001+0000 mon.smithi172 (mon.0) 394 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:09:26.367 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:26 smithi172 bash[24902]: audit 2023-12-07T17:09:25.306885+0000 mon.smithi172 (mon.0) 395 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:26.367 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:26 smithi172 bash[24902]: audit 2023-12-07T17:09:25.312290+0000 mon.smithi172 (mon.0) 396 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:27.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:27 smithi172 bash[24902]: cluster 2023-12-07T17:09:27.021582+0000 mgr.smithi172.nqsqxd (mgr.14199) 134 : cluster 0 pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:30.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:30 smithi172 bash[24902]: cluster 2023-12-07T17:09:29.022088+0000 mgr.smithi172.nqsqxd (mgr.14199) 135 : cluster 0 pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:32.342 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:32 smithi172 bash[24902]: cluster 2023-12-07T17:09:31.022636+0000 mgr.smithi172.nqsqxd (mgr.14199) 136 : cluster 0 pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:33.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.407260+0000 mon.smithi172 (mon.0) 397 : audit 1 from='osd.3 [v2:172.21.15.172:6826/4186923736,v1:172.21.15.172:6827/4186923736]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-07T17:09:33.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.847466+0000 mon.smithi172 (mon.0) 398 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:33.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.854580+0000 mon.smithi172 (mon.0) 399 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:33.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.856037+0000 mon.smithi172 (mon.0) 400 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:09:33.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.856907+0000 mon.smithi172 (mon.0) 401 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:09:33.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:33 smithi172 bash[24902]: audit 2023-12-07T17:09:32.863436+0000 mon.smithi172 (mon.0) 402 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:34.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: cluster 2023-12-07T17:09:33.023157+0000 mgr.smithi172.nqsqxd (mgr.14199) 137 : cluster 0 pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: audit 2023-12-07T17:09:33.088889+0000 mon.smithi172 (mon.0) 403 : audit 1 from='osd.3 [v2:172.21.15.172:6826/4186923736,v1:172.21.15.172:6827/4186923736]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-07T17:09:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: cluster 2023-12-07T17:09:33.094085+0000 mon.smithi172 (mon.0) 404 : cluster 0 osdmap e25: 4 total, 3 up, 4 in 2023-12-07T17:09:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: audit 2023-12-07T17:09:33.094686+0000 mon.smithi172 (mon.0) 405 : audit 1 from='osd.3 [v2:172.21.15.172:6826/4186923736,v1:172.21.15.172:6827/4186923736]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]: dispatch 2023-12-07T17:09:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: audit 2023-12-07T17:09:33.095157+0000 mon.smithi172 (mon.0) 406 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T17:09:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:34 smithi172 bash[24902]: audit 2023-12-07T17:09:34.073327+0000 mon.smithi172 (mon.0) 407 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:09:35.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:35 smithi172 bash[24902]: audit 2023-12-07T17:09:34.092532+0000 mon.smithi172 (mon.0) 408 : audit 1 from='osd.3 [v2:172.21.15.172:6826/4186923736,v1:172.21.15.172:6827/4186923736]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi172", "root=default"]}]': finished 2023-12-07T17:09:35.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:35 smithi172 bash[24902]: cluster 2023-12-07T17:09:34.098070+0000 mon.smithi172 (mon.0) 409 : cluster 0 osdmap e26: 4 total, 3 up, 4 in 2023-12-07T17:09:35.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:35 smithi172 bash[24902]: audit 2023-12-07T17:09:34.099099+0000 mon.smithi172 (mon.0) 410 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T17:09:35.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:35 smithi172 bash[24902]: audit 2023-12-07T17:09:34.107128+0000 mon.smithi172 (mon.0) 411 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T17:09:35.558 INFO:teuthology.orchestra.run.smithi172.stdout:Created osd(s) 3 on host 'smithi172' 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: cluster 2023-12-07T17:09:33.436498+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: cluster 2023-12-07T17:09:33.436601+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: cluster 2023-12-07T17:09:35.023564+0000 mgr.smithi172.nqsqxd (mgr.14199) 138 : cluster 0 pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: cluster 2023-12-07T17:09:35.108608+0000 mon.smithi172 (mon.0) 412 : cluster 1 osd.3 [v2:172.21.15.172:6826/4186923736,v1:172.21.15.172:6827/4186923736] boot 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: cluster 2023-12-07T17:09:35.108659+0000 mon.smithi172 (mon.0) 413 : cluster 0 osdmap e27: 4 total, 4 up, 4 in 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: audit 2023-12-07T17:09:35.109126+0000 mon.smithi172 (mon.0) 414 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: audit 2023-12-07T17:09:35.504597+0000 mon.smithi172 (mon.0) 415 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: audit 2023-12-07T17:09:35.515583+0000 mon.smithi172 (mon.0) 416 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:36.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:36 smithi172 bash[24902]: audit 2023-12-07T17:09:35.529609+0000 mon.smithi172 (mon.0) 417 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:09:36.367 DEBUG:teuthology.orchestra.run.smithi172:osd.3> sudo journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.3.service 2023-12-07T17:09:36.369 INFO:tasks.cephadm:Waiting for 4 OSDs to come up... 2023-12-07T17:09:36.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-07T17:09:36.454 INFO:journalctl@ceph.osd.3.smithi172.stdout:-- Logs begin at Sun 2022-08-14 12:20:24 UTC. -- 2023-12-07T17:09:37.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:37 smithi172 bash[24902]: cluster 2023-12-07T17:09:36.120040+0000 mon.smithi172 (mon.0) 418 : cluster 0 osdmap e28: 4 total, 4 up, 4 in 2023-12-07T17:09:38.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:38 smithi172 bash[24902]: cluster 2023-12-07T17:09:37.024094+0000 mgr.smithi172.nqsqxd (mgr.14199) 139 : cluster 0 pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:40.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:40 smithi172 bash[24902]: cluster 2023-12-07T17:09:39.024653+0000 mgr.smithi172.nqsqxd (mgr.14199) 140 : cluster 0 pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:40.526 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:09:42.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:42 smithi172 bash[24902]: cluster 2023-12-07T17:09:41.025259+0000 mgr.smithi172.nqsqxd (mgr.14199) 141 : cluster 0 pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:44.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:44 smithi172 bash[24902]: cluster 2023-12-07T17:09:43.025649+0000 mgr.smithi172.nqsqxd (mgr.14199) 142 : cluster 0 pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:45.234 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:09:46.047 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":28,"num_osds":4,"num_up_osds":4,"osd_up_since":1701968975,"num_in_osds":4,"osd_in_since":1701968947,"num_remapped_pgs":0} 2023-12-07T17:09:46.048 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T17:09:46.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:46 smithi172 bash[24902]: cluster 2023-12-07T17:09:45.026045+0000 mgr.smithi172.nqsqxd (mgr.14199) 143 : cluster 0 pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:46.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:46 smithi172 bash[24902]: audit 2023-12-07T17:09:45.235317+0000 mon.smithi172 (mon.0) 419 : audit 0 from='client.? 172.21.15.172:0/2530053120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: cephadm 2023-12-07T17:09:47.024874+0000 mgr.smithi172.nqsqxd (mgr.14199) 144 : cephadm 1 Detected new or changed devices on smithi172 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: cluster 2023-12-07T17:09:47.026628+0000 mgr.smithi172.nqsqxd (mgr.14199) 145 : cluster 0 pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.033104+0000 mon.smithi172 (mon.0) 420 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.043186+0000 mon.smithi172 (mon.0) 421 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.045617+0000 mon.smithi172 (mon.0) 422 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.047064+0000 mon.smithi172 (mon.0) 423 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.048368+0000 mon.smithi172 (mon.0) 424 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.049702+0000 mon.smithi172 (mon.0) 425 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: cephadm 2023-12-07T17:09:47.050789+0000 mgr.smithi172.nqsqxd (mgr.14199) 146 : cephadm 1 Adjusting osd_memory_target on smithi172 to 1980M 2023-12-07T17:09:48.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.057036+0000 mon.smithi172 (mon.0) 426 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:48.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.060391+0000 mon.smithi172 (mon.0) 427 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:09:48.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.061690+0000 mon.smithi172 (mon.0) 428 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:09:48.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:48 smithi172 bash[24902]: audit 2023-12-07T17:09:47.070129+0000 mon.smithi172 (mon.0) 429 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:09:50.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:50 smithi172 bash[24902]: cluster 2023-12-07T17:09:49.027143+0000 mgr.smithi172.nqsqxd (mgr.14199) 147 : cluster 0 pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:50.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:50 smithi172 bash[24902]: audit 2023-12-07T17:09:49.073750+0000 mon.smithi172 (mon.0) 430 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:09:50.879 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:09:52.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:52 smithi172 bash[24902]: cluster 2023-12-07T17:09:51.027686+0000 mgr.smithi172.nqsqxd (mgr.14199) 148 : cluster 0 pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:53.994 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:09:53.994 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":28,"fsid":"4fe67048-9522-11ee-95a2-87774f69a715","created":"2023-12-07T17:02:49.574193+0000","modified":"2023-12-07T17:09:36.112337+0000","last_up_change":"2023-12-07T17:09:35.101299+0000","last_in_change":"2023-12-07T17:09:07.132784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T17:07:47.544009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"213ee991-6535-49e3-bfc8-941445340d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6803","nonce":460654906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6805","nonce":460654906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6809","nonce":460654906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6807","nonce":460654906}]},"public_addr":"172.21.15.172:6803/460654906","cluster_addr":"172.21.15.172:6805/460654906","heartbeat_back_addr":"172.21.15.172:6809/460654906","heartbeat_front_addr":"172.21.15.172:6807/460654906","state":["exists","up"]},{"osd":1,"uuid":"d21a2906-5ca8-4fd5-810d-618d67d7dd7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6811","nonce":3382766665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6813","nonce":3382766665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6817","nonce":3382766665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6815","nonce":3382766665}]},"public_addr":"172.21.15.172:6811/3382766665","cluster_addr":"172.21.15.172:6813/3382766665","heartbeat_back_addr":"172.21.15.172:6817/3382766665","heartbeat_front_addr":"172.21.15.172:6815/3382766665","state":["exists","up"]},{"osd":2,"uuid":"5ef19ec0-7065-4d01-ba15-9c3fac98e483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6819","nonce":607648447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6821","nonce":607648447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6825","nonce":607648447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6823","nonce":607648447}]},"public_addr":"172.21.15.172:6819/607648447","cluster_addr":"172.21.15.172:6821/607648447","heartbeat_back_addr":"172.21.15.172:6825/607648447","heartbeat_front_addr":"172.21.15.172:6823/607648447","state":["exists","up"]},{"osd":3,"uuid":"01d14ba0-0e83-4f3b-ab37-0ef938adf7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6827","nonce":4186923736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6829","nonce":4186923736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6833","nonce":4186923736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6831","nonce":4186923736}]},"public_addr":"172.21.15.172:6827/4186923736","cluster_addr":"172.21.15.172:6829/4186923736","heartbeat_back_addr":"172.21.15.172:6833/4186923736","heartbeat_front_addr":"172.21.15.172:6831/4186923736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:06:49.572377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:07:43.720582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:08:38.207362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:09:33.436607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6801/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6800/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1397458450":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/2545714536":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6801/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6800/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/239102479":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/3495394666":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2601104439":"2023-12-08T17:03:24.201380+0000","172.21.15.172:6800/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3496563864":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1784336496":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6801/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2416551405":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3967193609":"2023-12-08T17:04:15.988481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T17:09:54.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:54 smithi172 bash[24902]: cluster 2023-12-07T17:09:53.028248+0000 mgr.smithi172.nqsqxd (mgr.14199) 149 : cluster 0 pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:54.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:54 smithi172 bash[24902]: audit 2023-12-07T17:09:53.994187+0000 mon.smithi172 (mon.0) 431 : audit 0 from='client.? 172.21.15.172:0/648747792' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T17:09:54.813 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-07T17:07:47.544009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.5, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-07T17:09:54.813 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-07T17:09:56.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:56 smithi172 bash[24902]: cluster 2023-12-07T17:09:55.028725+0000 mgr.smithi172.nqsqxd (mgr.14199) 150 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:57.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:09:57 smithi172 bash[24902]: cluster 2023-12-07T17:09:57.029231+0000 mgr.smithi172.nqsqxd (mgr.14199) 151 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:09:59.608 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:00.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:00 smithi172 bash[24902]: cluster 2023-12-07T17:09:59.029767+0000 mgr.smithi172.nqsqxd (mgr.14199) 152 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:02.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:02 smithi172 bash[24902]: cluster 2023-12-07T17:10:01.030211+0000 mgr.smithi172.nqsqxd (mgr.14199) 153 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:02.717 INFO:teuthology.orchestra.run.smithi172.stdout:pg_num: 1 2023-12-07T17:10:03.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:03 smithi172 bash[24902]: audit 2023-12-07T17:10:02.718259+0000 mon.smithi172 (mon.0) 432 : audit 0 from='client.? 172.21.15.172:0/41950572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-07T17:10:03.475 INFO:tasks.cephadm:Setting up client nodes... 2023-12-07T17:10:03.475 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-07T17:10:04.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:04 smithi172 bash[24902]: cluster 2023-12-07T17:10:03.030673+0000 mgr.smithi172.nqsqxd (mgr.14199) 154 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:04.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:04 smithi172 bash[24902]: audit 2023-12-07T17:10:04.074277+0000 mon.smithi172 (mon.0) 433 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:10:06.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:06 smithi172 bash[24902]: cluster 2023-12-07T17:10:05.031155+0000 mgr.smithi172.nqsqxd (mgr.14199) 155 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:07.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:07 smithi172 bash[24902]: cluster 2023-12-07T17:10:07.031703+0000 mgr.smithi172.nqsqxd (mgr.14199) 156 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:08.265 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:10.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:10 smithi172 bash[24902]: cluster 2023-12-07T17:10:09.032168+0000 mgr.smithi172.nqsqxd (mgr.14199) 157 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:11.647 INFO:teuthology.orchestra.run.smithi172.stdout:[client.0] 2023-12-07T17:10:11.647 INFO:teuthology.orchestra.run.smithi172.stdout: key = AQBz/HFlxkl/JhAAsWJjSxEjw1v+cNKR12T0mg== 2023-12-07T17:10:12.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:12 smithi172 bash[24902]: cluster 2023-12-07T17:10:11.032505+0000 mgr.smithi172.nqsqxd (mgr.14199) 158 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:12.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:12 smithi172 bash[24902]: audit 2023-12-07T17:10:11.645552+0000 mon.smithi172 (mon.0) 434 : audit 1 from='client.? 172.21.15.172:0/3252141185' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-07T17:10:12.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:12 smithi172 bash[24902]: audit 2023-12-07T17:10:11.648059+0000 mon.smithi172 (mon.0) 435 : audit 1 from='client.? 172.21.15.172:0/3252141185' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-07T17:10:12.434 DEBUG:teuthology.orchestra.run.smithi172:> set -ex 2023-12-07T17:10:12.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-07T17:10:12.434 DEBUG:teuthology.orchestra.run.smithi172:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-07T17:10:12.456 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-07T17:10:12.456 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-07T17:10:12.457 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-07T17:10:14.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:14 smithi172 bash[24902]: cluster 2023-12-07T17:10:13.033100+0000 mgr.smithi172.nqsqxd (mgr.14199) 159 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:16.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:16 smithi172 bash[24902]: cluster 2023-12-07T17:10:15.033657+0000 mgr.smithi172.nqsqxd (mgr.14199) 160 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:17.290 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:17.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:17 smithi172 bash[24902]: cluster 2023-12-07T17:10:17.034209+0000 mgr.smithi172.nqsqxd (mgr.14199) 161 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:19.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:19 smithi172 bash[24902]: audit 2023-12-07T17:10:19.074516+0000 mon.smithi172 (mon.0) 436 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:10:20.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:20 smithi172 bash[24902]: cluster 2023-12-07T17:10:19.034769+0000 mgr.smithi172.nqsqxd (mgr.14199) 162 : cluster 0 pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:20.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:10:21.373 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:21 smithi172 bash[24902]: audit 2023-12-07T17:10:20.797234+0000 mon.smithi172 (mon.0) 437 : audit 0 from='client.? 172.21.15.172:0/1515188600' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-07T17:10:21.587 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":19,"active_gid":14199,"active_name":"smithi172.nqsqxd","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6800","nonce":1168406798},{"type":"v1","addr":"172.21.15.172:6801","nonce":1168406798}]},"active_addr":"172.21.15.172:6801/1168406798","active_change":"2023-12-07T17:05:48.959979+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14197,"name":"smithi172.occzht","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.172:8443/","prometheus":"http://172.21.15.172:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1709800668}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":2433983451}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":1199254336}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.172:0","nonce":3770915135}]}]} 2023-12-07T17:10:21.592 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-07T17:10:21.592 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-07T17:10:21.592 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T17:10:22.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:22 smithi172 bash[24902]: cluster 2023-12-07T17:10:21.035286+0000 mgr.smithi172.nqsqxd (mgr.14199) 163 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:24.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:24 smithi172 bash[24902]: cluster 2023-12-07T17:10:23.035844+0000 mgr.smithi172.nqsqxd (mgr.14199) 164 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:26.388 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:26.418 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:26 smithi172 bash[24902]: cluster 2023-12-07T17:10:25.036358+0000 mgr.smithi172.nqsqxd (mgr.14199) 165 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:27.623 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:27 smithi172 bash[24902]: cluster 2023-12-07T17:10:27.036951+0000 mgr.smithi172.nqsqxd (mgr.14199) 166 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:29.481 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:10:29.481 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":28,"fsid":"4fe67048-9522-11ee-95a2-87774f69a715","created":"2023-12-07T17:02:49.574193+0000","modified":"2023-12-07T17:09:36.112337+0000","last_up_change":"2023-12-07T17:09:35.101299+0000","last_in_change":"2023-12-07T17:09:07.132784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T17:07:47.544009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"213ee991-6535-49e3-bfc8-941445340d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6803","nonce":460654906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6805","nonce":460654906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6809","nonce":460654906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6807","nonce":460654906}]},"public_addr":"172.21.15.172:6803/460654906","cluster_addr":"172.21.15.172:6805/460654906","heartbeat_back_addr":"172.21.15.172:6809/460654906","heartbeat_front_addr":"172.21.15.172:6807/460654906","state":["exists","up"]},{"osd":1,"uuid":"d21a2906-5ca8-4fd5-810d-618d67d7dd7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6811","nonce":3382766665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6813","nonce":3382766665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6817","nonce":3382766665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6815","nonce":3382766665}]},"public_addr":"172.21.15.172:6811/3382766665","cluster_addr":"172.21.15.172:6813/3382766665","heartbeat_back_addr":"172.21.15.172:6817/3382766665","heartbeat_front_addr":"172.21.15.172:6815/3382766665","state":["exists","up"]},{"osd":2,"uuid":"5ef19ec0-7065-4d01-ba15-9c3fac98e483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6819","nonce":607648447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6821","nonce":607648447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6825","nonce":607648447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6823","nonce":607648447}]},"public_addr":"172.21.15.172:6819/607648447","cluster_addr":"172.21.15.172:6821/607648447","heartbeat_back_addr":"172.21.15.172:6825/607648447","heartbeat_front_addr":"172.21.15.172:6823/607648447","state":["exists","up"]},{"osd":3,"uuid":"01d14ba0-0e83-4f3b-ab37-0ef938adf7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6827","nonce":4186923736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6829","nonce":4186923736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6833","nonce":4186923736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6831","nonce":4186923736}]},"public_addr":"172.21.15.172:6827/4186923736","cluster_addr":"172.21.15.172:6829/4186923736","heartbeat_back_addr":"172.21.15.172:6833/4186923736","heartbeat_front_addr":"172.21.15.172:6831/4186923736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:06:49.572377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:07:43.720582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:08:38.207362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:09:33.436607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6801/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6800/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1397458450":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/2545714536":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6801/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6800/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/239102479":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/3495394666":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2601104439":"2023-12-08T17:03:24.201380+0000","172.21.15.172:6800/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3496563864":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1784336496":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6801/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2416551405":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3967193609":"2023-12-08T17:04:15.988481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T17:10:30.289 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:30 smithi172 bash[24902]: cluster 2023-12-07T17:10:29.037409+0000 mgr.smithi172.nqsqxd (mgr.14199) 167 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:30.290 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:30 smithi172 bash[24902]: audit 2023-12-07T17:10:29.481498+0000 mon.smithi172 (mon.0) 438 : audit 0 from='client.? 172.21.15.172:0/571658650' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T17:10:30.291 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-07T17:10:30.291 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-07T17:10:32.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:32 smithi172 bash[24902]: cluster 2023-12-07T17:10:31.037988+0000 mgr.smithi172.nqsqxd (mgr.14199) 168 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:34 smithi172 bash[24902]: cluster 2023-12-07T17:10:33.038607+0000 mgr.smithi172.nqsqxd (mgr.14199) 169 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:34 smithi172 bash[24902]: audit 2023-12-07T17:10:34.074966+0000 mon.smithi172 (mon.0) 439 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:10:35.097 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:36.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:36 smithi172 bash[24902]: cluster 2023-12-07T17:10:35.039150+0000 mgr.smithi172.nqsqxd (mgr.14199) 170 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:37.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:37 smithi172 bash[24902]: cluster 2023-12-07T17:10:37.039734+0000 mgr.smithi172.nqsqxd (mgr.14199) 171 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:38.281 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:10:38.282 INFO:teuthology.orchestra.run.smithi172.stdout:{"epoch":28,"fsid":"4fe67048-9522-11ee-95a2-87774f69a715","created":"2023-12-07T17:02:49.574193+0000","modified":"2023-12-07T17:09:36.112337+0000","last_up_change":"2023-12-07T17:09:35.101299+0000","last_in_change":"2023-12-07T17:09:07.132784+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":10,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-07T17:07:47.544009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"213ee991-6535-49e3-bfc8-941445340d7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6802","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6803","nonce":460654906}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6804","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6805","nonce":460654906}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6808","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6809","nonce":460654906}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6806","nonce":460654906},{"type":"v1","addr":"172.21.15.172:6807","nonce":460654906}]},"public_addr":"172.21.15.172:6803/460654906","cluster_addr":"172.21.15.172:6805/460654906","heartbeat_back_addr":"172.21.15.172:6809/460654906","heartbeat_front_addr":"172.21.15.172:6807/460654906","state":["exists","up"]},{"osd":1,"uuid":"d21a2906-5ca8-4fd5-810d-618d67d7dd7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6810","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6811","nonce":3382766665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6812","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6813","nonce":3382766665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6816","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6817","nonce":3382766665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6814","nonce":3382766665},{"type":"v1","addr":"172.21.15.172:6815","nonce":3382766665}]},"public_addr":"172.21.15.172:6811/3382766665","cluster_addr":"172.21.15.172:6813/3382766665","heartbeat_back_addr":"172.21.15.172:6817/3382766665","heartbeat_front_addr":"172.21.15.172:6815/3382766665","state":["exists","up"]},{"osd":2,"uuid":"5ef19ec0-7065-4d01-ba15-9c3fac98e483","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":22,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6818","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6819","nonce":607648447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6820","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6821","nonce":607648447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6824","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6825","nonce":607648447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6822","nonce":607648447},{"type":"v1","addr":"172.21.15.172:6823","nonce":607648447}]},"public_addr":"172.21.15.172:6819/607648447","cluster_addr":"172.21.15.172:6821/607648447","heartbeat_back_addr":"172.21.15.172:6825/607648447","heartbeat_front_addr":"172.21.15.172:6823/607648447","state":["exists","up"]},{"osd":3,"uuid":"01d14ba0-0e83-4f3b-ab37-0ef938adf7cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6826","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6827","nonce":4186923736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6828","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6829","nonce":4186923736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6832","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6833","nonce":4186923736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.172:6830","nonce":4186923736},{"type":"v1","addr":"172.21.15.172:6831","nonce":4186923736}]},"public_addr":"172.21.15.172:6827/4186923736","cluster_addr":"172.21.15.172:6829/4186923736","heartbeat_back_addr":"172.21.15.172:6833/4186923736","heartbeat_front_addr":"172.21.15.172:6831/4186923736","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:06:49.572377+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:07:43.720582+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:08:38.207362+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-07T17:09:33.436607+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.172:6801/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6800/324320934":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1397458450":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/2545714536":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6801/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:6800/2990823983":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/239102479":"2023-12-08T17:04:15.988481+0000","172.21.15.172:0/3495394666":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2601104439":"2023-12-08T17:03:24.201380+0000","172.21.15.172:6800/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3496563864":"2023-12-08T17:05:48.959854+0000","172.21.15.172:0/1784336496":"2023-12-08T17:05:48.959854+0000","172.21.15.172:6801/270654951":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/2416551405":"2023-12-08T17:03:24.201380+0000","172.21.15.172:0/3967193609":"2023-12-08T17:04:15.988481+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-07T17:10:38.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:38 smithi172 bash[24902]: audit 2023-12-07T17:10:38.279998+0000 mon.smithi172 (mon.0) 440 : audit 0 from='client.? 172.21.15.172:0/1932240433' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-07T17:10:39.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-07T17:10:39.082 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-07T17:10:39.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-07T17:10:39.083 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-07T17:10:39.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:39 smithi172 bash[24902]: cluster 2023-12-07T17:10:39.040271+0000 mgr.smithi172.nqsqxd (mgr.14199) 172 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:42.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:42 smithi172 bash[24902]: cluster 2023-12-07T17:10:41.040771+0000 mgr.smithi172.nqsqxd (mgr.14199) 173 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:43.872 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:43.873 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:43.874 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:43.874 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:44.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:44 smithi172 bash[24902]: cluster 2023-12-07T17:10:43.041328+0000 mgr.smithi172.nqsqxd (mgr.14199) 174 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:46.370 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:46 smithi172 bash[24902]: cluster 2023-12-07T17:10:45.041780+0000 mgr.smithi172.nqsqxd (mgr.14199) 175 : cluster 0 pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:47.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:47 smithi172 bash[24902]: cluster 2023-12-07T17:10:47.042312+0000 mgr.smithi172.nqsqxd (mgr.14199) 176 : cluster 0 pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:47.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:47 smithi172 bash[24902]: audit 2023-12-07T17:10:47.121426+0000 mon.smithi172 (mon.0) 441 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:10:48.783 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:48 smithi172 bash[24902]: audit 2023-12-07T17:10:47.695324+0000 mon.smithi172 (mon.0) 442 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:10:48.783 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:48 smithi172 bash[24902]: audit 2023-12-07T17:10:47.696301+0000 mon.smithi172 (mon.0) 443 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:10:48.783 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:48 smithi172 bash[24902]: audit 2023-12-07T17:10:47.703853+0000 mon.smithi172 (mon.0) 444 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:10:49.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:49 smithi172 bash[24902]: cluster 2023-12-07T17:10:49.042704+0000 mgr.smithi172.nqsqxd (mgr.14199) 177 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:49.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:49 smithi172 bash[24902]: audit 2023-12-07T17:10:49.079219+0000 mon.smithi172 (mon.0) 445 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:10:52.077 INFO:teuthology.orchestra.run.smithi172.stdout:38654705714 2023-12-07T17:10:52.077 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-07T17:10:52.289 INFO:teuthology.orchestra.run.smithi172.stdout:94489280540 2023-12-07T17:10:52.290 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-07T17:10:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:52 smithi172 bash[24902]: cluster 2023-12-07T17:10:51.043161+0000 mgr.smithi172.nqsqxd (mgr.14199) 178 : cluster 0 pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:53.442 INFO:teuthology.orchestra.run.smithi172.stdout:60129542184 2023-12-07T17:10:53.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-07T17:10:53.458 INFO:teuthology.orchestra.run.smithi172.stdout:115964117011 2023-12-07T17:10:53.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-07T17:10:54.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:54 smithi172 bash[24902]: cluster 2023-12-07T17:10:53.043755+0000 mgr.smithi172.nqsqxd (mgr.14199) 179 : cluster 0 pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:56.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:56 smithi172 bash[24902]: cluster 2023-12-07T17:10:55.044297+0000 mgr.smithi172.nqsqxd (mgr.14199) 180 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:56.864 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:56.864 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:57.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:10:57 smithi172 bash[24902]: cluster 2023-12-07T17:10:57.044873+0000 mgr.smithi172.nqsqxd (mgr.14199) 181 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:10:57.884 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:10:57.884 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:00.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:00 smithi172 bash[24902]: cluster 2023-12-07T17:10:59.045339+0000 mgr.smithi172.nqsqxd (mgr.14199) 182 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:02.297 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:02 smithi172 bash[24902]: cluster 2023-12-07T17:11:01.045902+0000 mgr.smithi172.nqsqxd (mgr.14199) 183 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:04.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:04 smithi172 bash[24902]: cluster 2023-12-07T17:11:03.046375+0000 mgr.smithi172.nqsqxd (mgr.14199) 184 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:04.362 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:04 smithi172 bash[24902]: audit 2023-12-07T17:11:04.078955+0000 mon.smithi172 (mon.0) 446 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:11:04.481 INFO:teuthology.orchestra.run.smithi172.stdout:94489280543 2023-12-07T17:11:04.730 INFO:teuthology.orchestra.run.smithi172.stdout:38654705717 2023-12-07T17:11:05.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:05 smithi172 bash[24902]: audit 2023-12-07T17:11:04.481910+0000 mon.smithi172 (mon.0) 447 : audit 0 from='client.? 172.21.15.172:0/2704827769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-07T17:11:05.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:05 smithi172 bash[24902]: audit 2023-12-07T17:11:04.730827+0000 mon.smithi172 (mon.0) 448 : audit 0 from='client.? 172.21.15.172:0/3935679723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-07T17:11:05.725 INFO:teuthology.orchestra.run.smithi172.stdout:115964117013 2023-12-07T17:11:05.804 INFO:teuthology.orchestra.run.smithi172.stdout:60129542186 2023-12-07T17:11:06.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:06 smithi172 bash[24902]: cluster 2023-12-07T17:11:05.046794+0000 mgr.smithi172.nqsqxd (mgr.14199) 185 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:06.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:06 smithi172 bash[24902]: audit 2023-12-07T17:11:05.726700+0000 mon.smithi172 (mon.0) 449 : audit 0 from='client.? 172.21.15.172:0/2931611692' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-07T17:11:06.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:06 smithi172 bash[24902]: audit 2023-12-07T17:11:05.805493+0000 mon.smithi172 (mon.0) 450 : audit 0 from='client.? 172.21.15.172:0/731874825' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-07T17:11:06.441 INFO:tasks.cephadm.ceph_manager.ceph:need seq 94489280540 got 94489280543 for osd.2 2023-12-07T17:11:06.441 DEBUG:teuthology.parallel:result is None 2023-12-07T17:11:06.487 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705714 got 38654705717 for osd.0 2023-12-07T17:11:06.488 DEBUG:teuthology.parallel:result is None 2023-12-07T17:11:07.512 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117013 for osd.3 2023-12-07T17:11:07.512 DEBUG:teuthology.parallel:result is None 2023-12-07T17:11:07.548 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:07 smithi172 bash[24902]: cluster 2023-12-07T17:11:07.047254+0000 mgr.smithi172.nqsqxd (mgr.14199) 186 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:07.549 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542184 got 60129542186 for osd.1 2023-12-07T17:11:07.550 DEBUG:teuthology.parallel:result is None 2023-12-07T17:11:07.550 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-07T17:11:07.550 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-07T17:11:10.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:10 smithi172 bash[24902]: cluster 2023-12-07T17:11:09.047749+0000 mgr.smithi172.nqsqxd (mgr.14199) 187 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:12.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:12 smithi172 bash[24902]: cluster 2023-12-07T17:11:11.048270+0000 mgr.smithi172.nqsqxd (mgr.14199) 188 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:12.382 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:14.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:14 smithi172 bash[24902]: cluster 2023-12-07T17:11:13.048854+0000 mgr.smithi172.nqsqxd (mgr.14199) 189 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:15.414 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:11:15.417 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-12-07T17:11:16.125 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-12-07T17:11:15.049072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":374980608,"kb_used":110172,"kb_used_data":2088,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":374870436,"statfs":{"total":383980142592,"available":383867326464,"internally_reserved":0,"allocated":2138112,"data_stored":1508892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002855"},"pg_stats":[{"pgid":"1.0","version":"18'97","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-07T17:09:37.556859+0000","last_change":"2023-12-07T17:07:49.374644+0000","last_active":"2023-12-07T17:09:37.556859+0000","last_peered":"2023-12-07T17:09:37.556859+0000","last_clean":"2023-12-07T17:09:37.556859+0000","last_became_active":"2023-12-07T17:07:49.372517+0000","last_became_peered":"2023-12-07T17:07:49.372517+0000","last_unstale":"2023-12-07T17:09:37.556859+0000","last_undegraded":"2023-12-07T17:09:37.556859+0000","last_fullsized":"2023-12-07T17:09:37.556859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T17:07:47.594256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T17:07:47.594256+0000","last_clean_scrub_stamp":"2023-12-07T17:07:47.594256+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:48:41.343109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":27,"seq":115964117015,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717900,"statfs":{"total":95995035648,"available":95967129600,"internally_reserved":0,"allocated":237568,"data_stored":82039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.64200000000000002}]},{"osd":2,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.75600000000000001}]}]},{"osd":2,"up_from":22,"seq":94489280545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717900,"statfs":{"total":95995035648,"available":95967129600,"internally_reserved":0,"allocated":237568,"data_stored":82039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.873,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Dec 7 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.82799999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":672407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 17:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82199999999999995}]},{"osd":2,"last update":"Thu Dec 7 17:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.624,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85999999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Dec 7 17:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.73999999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":672407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.54500000000000004,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.77800000000000002}]},{"osd":3,"last update":"Thu Dec 7 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T17:11:16.126 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-07T17:11:16.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:16 smithi172 bash[24902]: cluster 2023-12-07T17:11:15.049248+0000 mgr.smithi172.nqsqxd (mgr.14199) 190 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:17.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:17 smithi172 bash[24902]: audit 2023-12-07T17:11:15.413457+0000 mgr.smithi172.nqsqxd (mgr.14199) 191 : audit 0 from='client.14280 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:11:18.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:18 smithi172 bash[24902]: cluster 2023-12-07T17:11:17.049805+0000 mgr.smithi172.nqsqxd (mgr.14199) 192 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:19.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:19 smithi172 bash[24902]: audit 2023-12-07T17:11:19.079915+0000 mon.smithi172 (mon.0) 451 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:11:20.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:20 smithi172 bash[24902]: cluster 2023-12-07T17:11:19.050298+0000 mgr.smithi172.nqsqxd (mgr.14199) 193 : cluster 0 pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:20.914 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:22.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:22 smithi172 bash[24902]: cluster 2023-12-07T17:11:21.050883+0000 mgr.smithi172.nqsqxd (mgr.14199) 194 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:23.692 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:11:23.696 INFO:teuthology.orchestra.run.smithi172.stderr:dumped all 2023-12-07T17:11:24.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:24 smithi172 bash[24902]: cluster 2023-12-07T17:11:23.051428+0000 mgr.smithi172.nqsqxd (mgr.14199) 195 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:24.519 INFO:teuthology.orchestra.run.smithi172.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2023-12-07T17:11:23.051159+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":2,"kb":374980608,"kb_used":110172,"kb_used_data":2088,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":374870436,"statfs":{"total":383980142592,"available":383867326464,"internally_reserved":0,"allocated":2138112,"data_stored":1508892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003117"},"pg_stats":[{"pgid":"1.0","version":"18'97","reported_seq":148,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-07T17:09:37.556859+0000","last_change":"2023-12-07T17:07:49.374644+0000","last_active":"2023-12-07T17:09:37.556859+0000","last_peered":"2023-12-07T17:09:37.556859+0000","last_clean":"2023-12-07T17:09:37.556859+0000","last_became_active":"2023-12-07T17:07:49.372517+0000","last_became_peered":"2023-12-07T17:07:49.372517+0000","last_unstale":"2023-12-07T17:09:37.556859+0000","last_undegraded":"2023-12-07T17:09:37.556859+0000","last_fullsized":"2023-12-07T17:09:37.556859+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-07T17:07:47.594256+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-07T17:07:47.594256+0000","last_clean_scrub_stamp":"2023-12-07T17:07:47.594256+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-08T17:48:41.343109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":27,"seq":115964117017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717900,"statfs":{"total":95995035648,"available":95967129600,"internally_reserved":0,"allocated":237568,"data_stored":82039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Dec 7 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76200000000000001}]}]},{"osd":2,"up_from":22,"seq":94489280547,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717900,"statfs":{"total":95995035648,"available":95967129600,"internally_reserved":0,"allocated":237568,"data_stored":82039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.59199999999999997},"min":{"1min":0.47899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82399999999999995,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.873,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.60199999999999998}]},{"osd":1,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67400000000000004,"15min":0.66400000000000003},"min":{"1min":0.51300000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.47599999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.745}]},{"osd":3,"last update":"Thu Dec 7 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.63900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27836,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717316,"statfs":{"total":95995035648,"available":95966531584,"internally_reserved":0,"allocated":831488,"data_stored":672407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Dec 7 17:10:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.42199999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Dec 7 17:10:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.624,"15min":0.61199999999999999},"min":{"1min":0.47899999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85999999999999999,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":1},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Dec 7 17:10:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.71099999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":831488,"data_stored":672407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Dec 7 17:10:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.55200000000000005,"15min":0.52800000000000002},"min":{"1min":0.54500000000000004,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.57299999999999995,"15min":0.55300000000000005},"min":{"1min":0.377,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.80400000000000005}]},{"osd":2,"last update":"Thu Dec 7 17:10:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.60799999999999998,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.42399999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Dec 7 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-07T17:11:24.519 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-07T17:11:24.520 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-07T17:11:24.520 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-07T17:11:24.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-07T17:11:25.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:25 smithi172 bash[24902]: audit 2023-12-07T17:11:23.689721+0000 mgr.smithi172.nqsqxd (mgr.14199) 196 : audit 0 from='client.14282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:11:26.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:26 smithi172 bash[24902]: cluster 2023-12-07T17:11:25.052056+0000 mgr.smithi172.nqsqxd (mgr.14199) 197 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:27.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:27 smithi172 bash[24902]: cluster 2023-12-07T17:11:27.052658+0000 mgr.smithi172.nqsqxd (mgr.14199) 198 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:29.306 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:30.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:30 smithi172 bash[24902]: cluster 2023-12-07T17:11:29.053133+0000 mgr.smithi172.nqsqxd (mgr.14199) 199 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:32.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:32 smithi172 bash[24902]: cluster 2023-12-07T17:11:31.053655+0000 mgr.smithi172.nqsqxd (mgr.14199) 200 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:32.591 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:11:32.591 INFO:teuthology.orchestra.run.smithi172.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-07T17:11:33.343 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-07T17:11:33.343 INFO:tasks.cephadm:Setup complete, yielding 2023-12-07T17:11:33.344 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-07T17:11:33.353 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi172.front.sepia.ceph.com 2023-12-07T17:11:33.354 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-07T17:11:33.365 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:33 smithi172 bash[24902]: audit 2023-12-07T17:11:32.591944+0000 mon.smithi172 (mon.0) 452 : audit 0 from='client.? 172.21.15.172:0/187858266' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-07T17:11:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:34 smithi172 bash[24902]: cluster 2023-12-07T17:11:33.054346+0000 mgr.smithi172.nqsqxd (mgr.14199) 201 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:34 smithi172 bash[24902]: audit 2023-12-07T17:11:34.080313+0000 mon.smithi172 (mon.0) 453 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:11:36.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:36 smithi172 bash[24902]: cluster 2023-12-07T17:11:35.054895+0000 mgr.smithi172.nqsqxd (mgr.14199) 202 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:37.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:37 smithi172 bash[24902]: cluster 2023-12-07T17:11:37.055517+0000 mgr.smithi172.nqsqxd (mgr.14199) 203 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:38.148 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:40.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:40 smithi172 bash[24902]: cluster 2023-12-07T17:11:39.056061+0000 mgr.smithi172.nqsqxd (mgr.14199) 204 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:41.401 INFO:teuthology.orchestra.run.smithi172.stdout:Backend: cephadm 2023-12-07T17:11:41.401 INFO:teuthology.orchestra.run.smithi172.stdout:Available: Yes 2023-12-07T17:11:41.401 INFO:teuthology.orchestra.run.smithi172.stdout:Paused: No 2023-12-07T17:11:42.191 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-07T17:11:42.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:42 smithi172 bash[24902]: cluster 2023-12-07T17:11:41.056640+0000 mgr.smithi172.nqsqxd (mgr.14199) 205 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:43.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:43 smithi172 bash[24902]: audit 2023-12-07T17:11:41.401447+0000 mgr.smithi172.nqsqxd (mgr.14199) 206 : audit 0 from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:11:44.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:44 smithi172 bash[24902]: cluster 2023-12-07T17:11:43.057204+0000 mgr.smithi172.nqsqxd (mgr.14199) 207 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:46.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:46 smithi172 bash[24902]: cluster 2023-12-07T17:11:45.057767+0000 mgr.smithi172.nqsqxd (mgr.14199) 208 : cluster 0 pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:47.033 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:47.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:47 smithi172 bash[24902]: cluster 2023-12-07T17:11:47.058408+0000 mgr.smithi172.nqsqxd (mgr.14199) 209 : cluster 0 pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:48.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:48 smithi172 bash[24902]: audit 2023-12-07T17:11:47.729441+0000 mon.smithi172 (mon.0) 454 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:11:48.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:48 smithi172 bash[24902]: audit 2023-12-07T17:11:48.303429+0000 mon.smithi172 (mon.0) 455 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:11:48.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:48 smithi172 bash[24902]: audit 2023-12-07T17:11:48.304871+0000 mon.smithi172 (mon.0) 456 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:11:48.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:48 smithi172 bash[24902]: audit 2023-12-07T17:11:48.310351+0000 mon.smithi172 (mon.0) 457 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:11:49.836 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:49 smithi172 bash[24902]: cluster 2023-12-07T17:11:49.058970+0000 mgr.smithi172.nqsqxd (mgr.14199) 210 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:49.837 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:49 smithi172 bash[24902]: audit 2023-12-07T17:11:49.080742+0000 mon.smithi172 (mon.0) 458 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:alertmanager.smithi172 smithi172 *:9093,9094 running (5m) 2m ago 6m 14.1M - 0.25.0 c8568f914cd2 aaf11d405d61 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-exporter.smithi172 smithi172 running (7m) 2m ago 7m 7747k - 19.0.0-64-ge068ebcf e71bc55fd8bb 2d1910e7be7d 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:crash.smithi172 smithi172 running (7m) 2m ago 7m 7136k - 19.0.0-64-ge068ebcf e71bc55fd8bb 5f7933b297d1 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:grafana.smithi172 smithi172 *:3000 running (5m) 2m ago 6m 76.3M - 9.4.7 954c08fa6188 b93514705f63 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:mgr.smithi172.nqsqxd smithi172 *:9283,8765,8443 running (8m) 2m ago 8m 472M - 19.0.0-64-ge068ebcf e71bc55fd8bb cccc884bbf3e 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:mgr.smithi172.occzht smithi172 *:8443,8765 running (6m) 2m ago 6m 423M - 19.0.0-64-ge068ebcf e71bc55fd8bb 711325fc9565 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:mon.smithi172 smithi172 running (8m) 2m ago 9m 44.1M 2048M 19.0.0-64-ge068ebcf e71bc55fd8bb 2d668324e526 2023-12-07T17:11:50.332 INFO:teuthology.orchestra.run.smithi172.stdout:node-exporter.smithi172 smithi172 *:9100 running (7m) 2m ago 7m 8487k - 1.5.0 0da6a335fe13 b67405d2ed56 2023-12-07T17:11:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:osd.0 smithi172 running (5m) 2m ago 5m 38.7M 1980M 19.0.0-64-ge068ebcf e71bc55fd8bb 9a0b4b141a9c 2023-12-07T17:11:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:osd.1 smithi172 running (4m) 2m ago 4m 38.5M 1980M 19.0.0-64-ge068ebcf e71bc55fd8bb d6835120edf8 2023-12-07T17:11:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:osd.2 smithi172 running (3m) 2m ago 3m 30.2M 1980M 19.0.0-64-ge068ebcf e71bc55fd8bb 9e19aee808a0 2023-12-07T17:11:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:osd.3 smithi172 running (2m) 2m ago 2m - 1980M 19.0.0-64-ge068ebcf e71bc55fd8bb 1af476b538da 2023-12-07T17:11:50.333 INFO:teuthology.orchestra.run.smithi172.stdout:prometheus.smithi172 smithi172 *:9095 running (6m) 2m ago 6m 36.9M - 2.43.0 a07b618ecd1d 9f86e6ee7eae 2023-12-07T17:11:51.106 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-07T17:11:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:52 smithi172 bash[24902]: audit 2023-12-07T17:11:50.315686+0000 mgr.smithi172.nqsqxd (mgr.14199) 211 : audit 0 from='client.14288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:11:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:52 smithi172 bash[24902]: cluster 2023-12-07T17:11:51.059448+0000 mgr.smithi172.nqsqxd (mgr.14199) 212 : cluster 0 pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:54.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:54 smithi172 bash[24902]: cluster 2023-12-07T17:11:53.060042+0000 mgr.smithi172.nqsqxd (mgr.14199) 213 : cluster 0 pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:55.900 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:11:56.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:56 smithi172 bash[24902]: cluster 2023-12-07T17:11:55.060609+0000 mgr.smithi172.nqsqxd (mgr.14199) 214 : cluster 0 pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:57.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:11:57 smithi172 bash[24902]: cluster 2023-12-07T17:11:57.061201+0000 mgr.smithi172.nqsqxd (mgr.14199) 215 : cluster 0 pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:ceph-exporter 1/1 2m ago 8m * 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:crash 1/1 2m ago 8m * 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:grafana ?:3000 1/1 2m ago 8m count:1 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:mgr 2/2 2m ago 8m count:2 2023-12-07T17:11:59.343 INFO:teuthology.orchestra.run.smithi172.stdout:mon 1/1 2m ago 6m smithi172:172.21.15.172=smithi172;count:1 2023-12-07T17:11:59.344 INFO:teuthology.orchestra.run.smithi172.stdout:node-exporter ?:9100 1/1 2m ago 8m * 2023-12-07T17:11:59.344 INFO:teuthology.orchestra.run.smithi172.stdout:osd 4 2m ago - 2023-12-07T17:11:59.344 INFO:teuthology.orchestra.run.smithi172.stdout:prometheus ?:9095 1/1 2m ago 8m count:1 2023-12-07T17:12:00.167 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-07T17:12:00.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:00 smithi172 bash[24902]: cluster 2023-12-07T17:11:59.061538+0000 mgr.smithi172.nqsqxd (mgr.14199) 216 : cluster 0 pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:01.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:01 smithi172 bash[24902]: audit 2023-12-07T17:11:59.334754+0000 mgr.smithi172.nqsqxd (mgr.14199) 217 : audit 0 from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:12:02.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:02 smithi172 bash[24902]: cluster 2023-12-07T17:12:01.062048+0000 mgr.smithi172.nqsqxd (mgr.14199) 218 : cluster 0 pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:04.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:04 smithi172 bash[24902]: cluster 2023-12-07T17:12:03.062669+0000 mgr.smithi172.nqsqxd (mgr.14199) 219 : cluster 0 pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:04.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:04 smithi172 bash[24902]: audit 2023-12-07T17:12:04.081396+0000 mon.smithi172 (mon.0) 459 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:12:04.955 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:12:06.549 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:06 smithi172 bash[24902]: cluster 2023-12-07T17:12:05.063163+0000 mgr.smithi172.nqsqxd (mgr.14199) 220 : cluster 0 pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:07.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:07 smithi172 bash[24902]: cluster 2023-12-07T17:12:07.063685+0000 mgr.smithi172.nqsqxd (mgr.14199) 221 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:08.200 INFO:teuthology.orchestra.run.smithi172.stdout:HOST ADDR LABELS STATUS 2023-12-07T17:12:08.200 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 172.21.15.172 2023-12-07T17:12:08.201 INFO:teuthology.orchestra.run.smithi172.stdout:1 hosts in cluster 2023-12-07T17:12:08.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:08 smithi172 bash[24902]: audit 2023-12-07T17:12:08.199487+0000 mgr.smithi172.nqsqxd (mgr.14199) 222 : audit 0 from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:12:09.008 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-07T17:12:09.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:09 smithi172 bash[24902]: cluster 2023-12-07T17:12:09.064217+0000 mgr.smithi172.nqsqxd (mgr.14199) 223 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:12.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:12 smithi172 bash[24902]: cluster 2023-12-07T17:12:11.064722+0000 mgr.smithi172.nqsqxd (mgr.14199) 224 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:13.796 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:12:14.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:14 smithi172 bash[24902]: cluster 2023-12-07T17:12:13.065348+0000 mgr.smithi172.nqsqxd (mgr.14199) 225 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:16.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:16 smithi172 bash[24902]: cluster 2023-12-07T17:12:15.065880+0000 mgr.smithi172.nqsqxd (mgr.14199) 226 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:17.086 INFO:teuthology.orchestra.run.smithi172.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-07T17:12:17.086 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233005M400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-12-07T17:12:17.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:17 smithi172 bash[24902]: cluster 2023-12-07T17:12:17.066424+0000 mgr.smithi172.nqsqxd (mgr.14199) 227 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:17.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:17 smithi172 bash[24902]: audit 2023-12-07T17:12:17.084555+0000 mgr.smithi172.nqsqxd (mgr.14199) 228 : audit 0 from='client.14294 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:12:17.836 INFO:teuthology.run_tasks:Running task cephadm.apply... 2023-12-07T17:12:17.846 INFO:tasks.cephadm:Applying spec(s): placement: count_per_host: 4 host_pattern: '*' service_id: foo service_type: rgw spec: rgw_frontend_port: 8000 2023-12-07T17:12:17.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch apply -i - 2023-12-07T17:12:19.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:19 smithi172 bash[24902]: audit 2023-12-07T17:12:19.081339+0000 mon.smithi172 (mon.0) 460 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:12:20.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:20 smithi172 bash[24902]: cluster 2023-12-07T17:12:19.066874+0000 mgr.smithi172.nqsqxd (mgr.14199) 229 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:22.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:22 smithi172 bash[24902]: cluster 2023-12-07T17:12:21.067431+0000 mgr.smithi172.nqsqxd (mgr.14199) 230 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:22.642 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:12:24.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:24 smithi172 bash[24902]: cluster 2023-12-07T17:12:23.068064+0000 mgr.smithi172.nqsqxd (mgr.14199) 231 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:25.785 INFO:teuthology.orchestra.run.smithi172.stdout:Scheduled rgw.foo update... 2023-12-07T17:12:26.387 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: cluster 2023-12-07T17:12:25.068610+0000 mgr.smithi172.nqsqxd (mgr.14199) 232 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:26.387 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.784721+0000 mon.smithi172 (mon.0) 461 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.813861+0000 mon.smithi172 (mon.0) 462 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.816039+0000 mon.smithi172 (mon.0) 463 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.817354+0000 mon.smithi172 (mon.0) 464 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.826138+0000 mon.smithi172 (mon.0) 465 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.831031+0000 mon.smithi172 (mon.0) 466 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vkjzkx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-12-07T17:12:26.388 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.834805+0000 mon.smithi172 (mon.0) 467 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vkjzkx", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-12-07T17:12:26.389 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.842511+0000 mon.smithi172 (mon.0) 468 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:26.389 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:26 smithi172 bash[24902]: audit 2023-12-07T17:12:25.844913+0000 mon.smithi172 (mon.0) 469 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:26.975 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2023-12-07T17:12:26.986 INFO:tasks.cephadm:Waiting for ceph service rgw.foo to start (timeout 300)... 2023-12-07T17:12:26.986 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:12:27.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:27 smithi172 bash[24902]: audit 2023-12-07T17:12:25.772865+0000 mgr.smithi172.nqsqxd (mgr.14199) 233 : audit 0 from='client.14296 -' entity='client.admin' cmd=[{"prefix": "orch apply", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:12:27.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:27 smithi172 bash[24902]: cephadm 2023-12-07T17:12:25.779701+0000 mgr.smithi172.nqsqxd (mgr.14199) 234 : cephadm 1 Saving service rgw.foo spec with placement count-per-host:4;* 2023-12-07T17:12:27.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:27 smithi172 bash[24902]: cephadm 2023-12-07T17:12:25.846529+0000 mgr.smithi172.nqsqxd (mgr.14199) 235 : cephadm 1 Deploying daemon rgw.foo.smithi172.vkjzkx on smithi172 2023-12-07T17:12:28.482 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:28 smithi172 bash[24902]: cluster 2023-12-07T17:12:27.068985+0000 mgr.smithi172.nqsqxd (mgr.14199) 236 : cluster 0 pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.044464+0000 mon.smithi172 (mon.0) 470 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.051295+0000 mon.smithi172 (mon.0) 471 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: cluster 2023-12-07T17:12:29.069288+0000 mgr.smithi172.nqsqxd (mgr.14199) 237 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.072418+0000 mon.smithi172 (mon.0) 472 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.073268+0000 mon.smithi172 (mon.0) 473 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vcqlox", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.074306+0000 mon.smithi172 (mon.0) 474 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vcqlox", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.078192+0000 mon.smithi172 (mon.0) 475 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: audit 2023-12-07T17:12:29.079752+0000 mon.smithi172 (mon.0) 476 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:30 smithi172 bash[24902]: cephadm 2023-12-07T17:12:29.080905+0000 mgr.smithi172.nqsqxd (mgr.14199) 238 : cephadm 1 Deploying daemon rgw.foo.smithi172.vcqlox on smithi172 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: cluster 2023-12-07T17:12:31.069575+0000 mgr.smithi172.nqsqxd (mgr.14199) 239 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: cluster 2023-12-07T17:12:31.207109+0000 mon.smithi172 (mon.0) 477 : cluster 0 osdmap e29: 4 total, 4 up, 4 in 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:31.214078+0000 mon.smithi172 (mon.0) 478 : audit 1 from='client.? 172.21.15.172:0/2449752441' entity='client.rgw.foo.smithi172.vkjzkx' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.106334+0000 mon.smithi172 (mon.0) 479 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.118267+0000 mon.smithi172 (mon.0) 480 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.156398+0000 mon.smithi172 (mon.0) 481 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:32.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.157637+0000 mon.smithi172 (mon.0) 482 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.uqvxqq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-12-07T17:12:32.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.158895+0000 mon.smithi172 (mon.0) 483 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.uqvxqq", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-12-07T17:12:32.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.163469+0000 mon.smithi172 (mon.0) 484 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:32.401 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:32 smithi172 bash[24902]: audit 2023-12-07T17:12:32.165368+0000 mon.smithi172 (mon.0) 485 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:32.774 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:12:33.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:33 smithi172 bash[24902]: cephadm 2023-12-07T17:12:32.166571+0000 mgr.smithi172.nqsqxd (mgr.14199) 240 : cephadm 1 Deploying daemon rgw.foo.smithi172.uqvxqq on smithi172 2023-12-07T17:12:33.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:33 smithi172 bash[24902]: audit 2023-12-07T17:12:32.209508+0000 mon.smithi172 (mon.0) 486 : audit 1 from='client.? 172.21.15.172:0/2449752441' entity='client.rgw.foo.smithi172.vkjzkx' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2023-12-07T17:12:33.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:33 smithi172 bash[24902]: cluster 2023-12-07T17:12:32.212526+0000 mon.smithi172 (mon.0) 487 : cluster 0 osdmap e30: 4 total, 4 up, 4 in 2023-12-07T17:12:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:34 smithi172 bash[24902]: cluster 2023-12-07T17:12:33.070113+0000 mgr.smithi172.nqsqxd (mgr.14199) 241 : cluster 0 pgmap v220: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:34.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:34 smithi172 bash[24902]: cluster 2023-12-07T17:12:33.219576+0000 mon.smithi172 (mon.0) 488 : cluster 0 osdmap e31: 4 total, 4 up, 4 in 2023-12-07T17:12:34.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:34 smithi172 bash[24902]: audit 2023-12-07T17:12:34.082181+0000 mon.smithi172 (mon.0) 489 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:12:36.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:36 smithi172 bash[24902]: cluster 2023-12-07T17:12:35.070659+0000 mgr.smithi172.nqsqxd (mgr.14199) 242 : cluster 0 pgmap v222: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:12:37.844 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:37 smithi172 bash[24902]: cluster 2023-12-07T17:12:37.071176+0000 mgr.smithi172.nqsqxd (mgr.14199) 243 : cluster 0 pgmap v223: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1023 B/s rd, 1023 B/s wr, 2 op/s 2023-12-07T17:12:38.322 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:12:38.323 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:09:32.840204Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:09:32.839856Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:09:32.839973Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:09:32.840319Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:09:32.839726Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:09:32.839582Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:09:32.840088Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:09:32.840661Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:09:32.840547Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:38.198360Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:25.779968Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:12:39.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.144022+0000 mon.smithi172 (mon.0) 490 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:39.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.150172+0000 mon.smithi172 (mon.0) 491 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.198076+0000 mon.smithi172 (mon.0) 492 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.199220+0000 mon.smithi172 (mon.0) 493 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vknhna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.200119+0000 mon.smithi172 (mon.0) 494 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi172.vknhna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.203806+0000 mon.smithi172 (mon.0) 495 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: audit 2023-12-07T17:12:38.205395+0000 mon.smithi172 (mon.0) 496 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:39.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:39 smithi172 bash[24902]: cephadm 2023-12-07T17:12:38.206385+0000 mgr.smithi172.nqsqxd (mgr.14199) 244 : cephadm 1 Deploying daemon rgw.foo.smithi172.vknhna on smithi172 2023-12-07T17:12:39.836 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:12:40.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:40 smithi172 bash[24902]: audit 2023-12-07T17:12:38.316154+0000 mgr.smithi172.nqsqxd (mgr.14199) 245 : audit 0 from='client.14314 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:12:40.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:40 smithi172 bash[24902]: cluster 2023-12-07T17:12:39.071524+0000 mgr.smithi172.nqsqxd (mgr.14199) 246 : cluster 0 pgmap v224: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 780 B/s rd, 780 B/s wr, 2 op/s 2023-12-07T17:12:40.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:12:42.642 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:42 smithi172 bash[24902]: cluster 2023-12-07T17:12:41.072158+0000 mgr.smithi172.nqsqxd (mgr.14199) 247 : cluster 0 pgmap v225: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.1 KiB/s rd, 693 B/s wr, 2 op/s 2023-12-07T17:12:43.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.228406+0000 mon.smithi172 (mon.0) 497 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:43.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.234539+0000 mon.smithi172 (mon.0) 498 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:43.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.288292+0000 mon.smithi172 (mon.0) 499 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:43.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.292458+0000 mon.smithi172 (mon.0) 500 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:43.488 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.295771+0000 mon.smithi172 (mon.0) 501 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:43.489 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:43 smithi172 bash[24902]: audit 2023-12-07T17:12:42.333195+0000 mon.smithi172 (mon.0) 502 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:12:44.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:44 smithi172 bash[24902]: cephadm 2023-12-07T17:12:42.289587+0000 mgr.smithi172.nqsqxd (mgr.14199) 248 : cephadm 1 Saving service rgw.foo spec with placement count-per-host:4;* 2023-12-07T17:12:44.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:44 smithi172 bash[24902]: cluster 2023-12-07T17:12:43.072633+0000 mgr.smithi172.nqsqxd (mgr.14199) 249 : cluster 0 pgmap v226: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.2 KiB/s rd, 614 B/s wr, 2 op/s 2023-12-07T17:12:44.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:44 smithi172 bash[24902]: audit 2023-12-07T17:12:44.090477+0000 mon.smithi172 (mon.0) 503 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:45.844 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:12:46.415 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:46 smithi172 bash[24902]: cluster 2023-12-07T17:12:45.073186+0000 mgr.smithi172.nqsqxd (mgr.14199) 250 : cluster 0 pgmap v227: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.0 KiB/s rd, 518 B/s wr, 1 op/s 2023-12-07T17:12:47.583 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:47 smithi172 bash[24902]: cluster 2023-12-07T17:12:47.073948+0000 mgr.smithi172.nqsqxd (mgr.14199) 251 : cluster 0 pgmap v228: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.7 KiB/s rd, 511 B/s wr, 2 op/s 2023-12-07T17:12:49.367 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:49 smithi172 bash[24902]: audit 2023-12-07T17:12:49.024415+0000 mon.smithi172 (mon.0) 504 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]: dispatch 2023-12-07T17:12:49.367 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:49 smithi172 bash[24902]: audit 2023-12-07T17:12:49.024991+0000 mon.smithi172 (mon.0) 505 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 1]}]: dispatch 2023-12-07T17:12:50.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: cluster 2023-12-07T17:12:49.074523+0000 mgr.smithi172.nqsqxd (mgr.14199) 252 : cluster 0 pgmap v229: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: audit 2023-12-07T17:12:49.075992+0000 mon.smithi172 (mon.0) 506 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 2]}]': finished 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: audit 2023-12-07T17:12:49.076182+0000 mon.smithi172 (mon.0) 507 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [3, 1]}]': finished 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: cluster 2023-12-07T17:12:49.081898+0000 mon.smithi172 (mon.0) 508 : cluster 0 osdmap e32: 4 total, 4 up, 4 in 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: audit 2023-12-07T17:12:49.087666+0000 mon.smithi172 (mon.0) 509 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: audit 2023-12-07T17:12:50.027402+0000 mon.smithi172 (mon.0) 510 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: audit 2023-12-07T17:12:50.033007+0000 mon.smithi172 (mon.0) 511 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:50 smithi172 bash[24902]: cluster 2023-12-07T17:12:50.080367+0000 mon.smithi172 (mon.0) 512 : cluster 0 osdmap e33: 4 total, 4 up, 4 in 2023-12-07T17:12:51.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:51 smithi172 bash[24902]: audit 2023-12-07T17:12:50.663515+0000 mon.smithi172 (mon.0) 513 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:12:51.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:51 smithi172 bash[24902]: audit 2023-12-07T17:12:50.664607+0000 mon.smithi172 (mon.0) 514 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:12:51.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:51 smithi172 bash[24902]: audit 2023-12-07T17:12:50.994433+0000 mon.smithi172 (mon.0) 515 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:12:51.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:51 smithi172 bash[24902]: audit 2023-12-07T17:12:51.049376+0000 mon.smithi172 (mon.0) 516 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:12:51.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:12:51.559 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:50.021605Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:50.021229Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:50.021357Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:50.021729Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:50.021093Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:50.020915Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:50.021481Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:50.022102Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:50.021979Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:50.022629Z", "ports": [8000], "running": 2, "size": 4}}] 2023-12-07T17:12:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:52 smithi172 bash[24902]: cluster 2023-12-07T17:12:50.666313+0000 mgr.smithi172.nqsqxd (mgr.14199) 253 : cluster 0 pgmap v232: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.1 KiB/s rd, 1 op/s 2023-12-07T17:12:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:52 smithi172 bash[24902]: cephadm 2023-12-07T17:12:50.668955+0000 mgr.smithi172.nqsqxd (mgr.14199) 254 : cephadm 1 Checking dashboard <-> RGW credentials 2023-12-07T17:12:52.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:52 smithi172 bash[24902]: cluster 2023-12-07T17:12:51.084737+0000 mon.smithi172 (mon.0) 517 : cluster 3 Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-12-07T17:12:52.932 INFO:tasks.cephadm:rgw.foo has 2/4 2023-12-07T17:12:53.214 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:53 smithi172 bash[24902]: audit 2023-12-07T17:12:51.548975+0000 mgr.smithi172.nqsqxd (mgr.14199) 255 : audit 0 from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:12:53.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:12:54.231 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:54 smithi172 bash[24902]: cluster 2023-12-07T17:12:52.669489+0000 mgr.smithi172.nqsqxd (mgr.14199) 256 : cluster 0 pgmap v233: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.4 KiB/s rd, 2 op/s 2023-12-07T17:12:56.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:56 smithi172 bash[24902]: cluster 2023-12-07T17:12:54.670079+0000 mgr.smithi172.nqsqxd (mgr.14199) 257 : cluster 0 pgmap v234: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.3 KiB/s rd, 1 op/s 2023-12-07T17:12:57.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:12:57 smithi172 bash[24902]: cluster 2023-12-07T17:12:56.670905+0000 mgr.smithi172.nqsqxd (mgr.14199) 258 : cluster 0 pgmap v235: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.9 KiB/s rd, 2 op/s 2023-12-07T17:12:59.279 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: cluster 2023-12-07T17:12:58.671346+0000 mgr.smithi172.nqsqxd (mgr.14199) 259 : cluster 0 pgmap v236: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.3 KiB/s rd, 2 op/s 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: audit 2023-12-07T17:12:59.044892+0000 mon.smithi172 (mon.0) 518 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: audit 2023-12-07T17:12:59.054387+0000 mon.smithi172 (mon.0) 519 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: audit 2023-12-07T17:12:59.056120+0000 mon.smithi172 (mon.0) 520 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: audit 2023-12-07T17:12:59.057127+0000 mon.smithi172 (mon.0) 521 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: cluster 2023-12-07T17:12:59.059266+0000 mgr.smithi172.nqsqxd (mgr.14199) 260 : cluster 0 pgmap v237: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.4 KiB/s rd, 2 op/s 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: cluster 2023-12-07T17:12:59.059804+0000 mgr.smithi172.nqsqxd (mgr.14199) 261 : cluster 0 pgmap v238: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.6 KiB/s rd, 2 op/s 2023-12-07T17:13:00.317 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: cephadm 2023-12-07T17:12:59.064332+0000 mgr.smithi172.nqsqxd (mgr.14199) 262 : cephadm 1 Checking dashboard <-> RGW credentials 2023-12-07T17:13:00.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:00 smithi172 bash[24902]: audit 2023-12-07T17:12:59.416602+0000 mon.smithi172 (mon.0) 522 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:13:01.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:01 smithi172 bash[24902]: cluster 2023-12-07T17:13:00.052392+0000 mon.smithi172 (mon.0) 523 : cluster 3 Health check update: 3 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-12-07T17:13:02.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:02 smithi172 bash[24902]: cluster 2023-12-07T17:13:01.060545+0000 mgr.smithi172.nqsqxd (mgr.14199) 263 : cluster 0 pgmap v239: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.9 KiB/s rd, 1 op/s 2023-12-07T17:13:03.589 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:13:03.589 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:13:04.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:04 smithi172 bash[24902]: cluster 2023-12-07T17:13:03.061018+0000 mgr.smithi172.nqsqxd (mgr.14199) 264 : cluster 0 pgmap v240: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.1 KiB/s rd, 2 op/s 2023-12-07T17:13:04.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:04 smithi172 bash[24902]: audit 2023-12-07T17:13:04.088249+0000 mon.smithi172 (mon.0) 524 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:13:04.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:04 smithi172 bash[24902]: audit 2023-12-07T17:13:04.089808+0000 mon.smithi172 (mon.0) 525 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:13:05.214 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:13:05.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:05 smithi172 bash[24902]: audit 2023-12-07T17:13:03.578664+0000 mgr.smithi172.nqsqxd (mgr.14199) 265 : audit 0 from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:13:06.215 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:13:06.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:06 smithi172 bash[24902]: cluster 2023-12-07T17:13:05.061381+0000 mgr.smithi172.nqsqxd (mgr.14199) 266 : cluster 0 pgmap v241: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 732 B/s rd, 0 op/s 2023-12-07T17:13:07.579 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:07 smithi172 bash[24902]: cluster 2023-12-07T17:13:07.062181+0000 mgr.smithi172.nqsqxd (mgr.14199) 267 : cluster 0 pgmap v242: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.1 KiB/s rd, 2 op/s 2023-12-07T17:13:10.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:10 smithi172 bash[24902]: cluster 2023-12-07T17:13:09.062813+0000 mgr.smithi172.nqsqxd (mgr.14199) 268 : cluster 0 pgmap v243: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.8 KiB/s rd, 1 op/s 2023-12-07T17:13:11.493 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:12.397 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:12 smithi172 bash[24902]: cluster 2023-12-07T17:13:11.063479+0000 mgr.smithi172.nqsqxd (mgr.14199) 269 : cluster 0 pgmap v244: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.8 KiB/s rd, 1 op/s 2023-12-07T17:13:14.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:14 smithi172 bash[24902]: cluster 2023-12-07T17:13:13.064107+0000 mgr.smithi172.nqsqxd (mgr.14199) 270 : cluster 0 pgmap v245: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.7 KiB/s rd, 1 op/s 2023-12-07T17:13:16.371 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:16 smithi172 bash[24902]: cluster 2023-12-07T17:13:15.064680+0000 mgr.smithi172.nqsqxd (mgr.14199) 271 : cluster 0 pgmap v246: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:13:16.782 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:13:17.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:17 smithi172 bash[24902]: audit 2023-12-07T17:13:16.778106+0000 mgr.smithi172.nqsqxd (mgr.14199) 272 : audit 0 from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:13:17.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:17 smithi172 bash[24902]: cluster 2023-12-07T17:13:17.065478+0000 mgr.smithi172.nqsqxd (mgr.14199) 273 : cluster 0 pgmap v247: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:18.672 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:13:19.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:19 smithi172 bash[24902]: audit 2023-12-07T17:13:19.083275+0000 mon.smithi172 (mon.0) 526 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:13:19.673 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:13:20.393 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:20 smithi172 bash[24902]: cluster 2023-12-07T17:13:19.065986+0000 mgr.smithi172.nqsqxd (mgr.14199) 274 : cluster 0 pgmap v248: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1023 B/s rd, 0 op/s 2023-12-07T17:13:22.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:22 smithi172 bash[24902]: cluster 2023-12-07T17:13:21.066697+0000 mgr.smithi172.nqsqxd (mgr.14199) 275 : cluster 0 pgmap v249: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:24.461 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:24.493 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:24 smithi172 bash[24902]: cluster 2023-12-07T17:13:23.067463+0000 mgr.smithi172.nqsqxd (mgr.14199) 276 : cluster 0 pgmap v250: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.2 KiB/s rd, 2 op/s 2023-12-07T17:13:26.405 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:26 smithi172 bash[24902]: cluster 2023-12-07T17:13:25.068118+0000 mgr.smithi172.nqsqxd (mgr.14199) 277 : cluster 0 pgmap v251: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:27.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:27 smithi172 bash[24902]: cluster 2023-12-07T17:13:27.068919+0000 mgr.smithi172.nqsqxd (mgr.14199) 278 : cluster 0 pgmap v252: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:28.190 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:13:28.190 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:13:28.858 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:28 smithi172 bash[24902]: audit 2023-12-07T17:13:28.185349+0000 mgr.smithi172.nqsqxd (mgr.14199) 279 : audit 0 from='client.14486 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:13:29.874 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:29 smithi172 bash[24902]: cluster 2023-12-07T17:13:29.069561+0000 mgr.smithi172.nqsqxd (mgr.14199) 280 : cluster 0 pgmap v253: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:29.958 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:13:30.959 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:13:32.374 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:32 smithi172 bash[24902]: cluster 2023-12-07T17:13:31.070262+0000 mgr.smithi172.nqsqxd (mgr.14199) 281 : cluster 0 pgmap v254: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.2 KiB/s rd, 2 op/s 2023-12-07T17:13:34.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:34 smithi172 bash[24902]: cluster 2023-12-07T17:13:33.070850+0000 mgr.smithi172.nqsqxd (mgr.14199) 282 : cluster 0 pgmap v255: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:34.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:34 smithi172 bash[24902]: audit 2023-12-07T17:13:34.084034+0000 mon.smithi172 (mon.0) 527 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:13:36.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:36 smithi172 bash[24902]: cluster 2023-12-07T17:13:35.071371+0000 mgr.smithi172.nqsqxd (mgr.14199) 283 : cluster 0 pgmap v256: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1023 B/s rd, 0 op/s 2023-12-07T17:13:36.747 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:37.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:37 smithi172 bash[24902]: cluster 2023-12-07T17:13:37.072159+0000 mgr.smithi172.nqsqxd (mgr.14199) 284 : cluster 0 pgmap v257: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:40.333 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:40 smithi172 bash[24902]: cluster 2023-12-07T17:13:39.072787+0000 mgr.smithi172.nqsqxd (mgr.14199) 285 : cluster 0 pgmap v258: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.0 KiB/s rd, 1 op/s 2023-12-07T17:13:40.487 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:13:40.488 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:13:41.835 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:13:42.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:42 smithi172 bash[24902]: audit 2023-12-07T17:13:40.479471+0000 mgr.smithi172.nqsqxd (mgr.14199) 286 : audit 0 from='client.14512 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:13:42.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:42 smithi172 bash[24902]: cluster 2023-12-07T17:13:41.073247+0000 mgr.smithi172.nqsqxd (mgr.14199) 287 : cluster 0 pgmap v259: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.3 KiB/s rd, 2 op/s 2023-12-07T17:13:42.837 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:13:44.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:44 smithi172 bash[24902]: cluster 2023-12-07T17:13:43.073970+0000 mgr.smithi172.nqsqxd (mgr.14199) 288 : cluster 0 pgmap v260: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.8 KiB/s rd, 1 op/s 2023-12-07T17:13:46.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:46 smithi172 bash[24902]: cluster 2023-12-07T17:13:45.074508+0000 mgr.smithi172.nqsqxd (mgr.14199) 289 : cluster 0 pgmap v261: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:47.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:47 smithi172 bash[24902]: cluster 2023-12-07T17:13:47.075206+0000 mgr.smithi172.nqsqxd (mgr.14199) 290 : cluster 0 pgmap v262: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 2.5 KiB/s rd, 2 op/s 2023-12-07T17:13:47.639 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:49.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:49 smithi172 bash[24902]: audit 2023-12-07T17:13:49.083717+0000 mon.smithi172 (mon.0) 528 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:13:50.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:50 smithi172 bash[24902]: cluster 2023-12-07T17:13:49.075856+0000 mgr.smithi172.nqsqxd (mgr.14199) 291 : cluster 0 pgmap v263: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:50.773 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:13:50.773 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:13:51.596 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:13:52.597 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:13:52.610 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:52 smithi172 bash[24902]: audit 2023-12-07T17:13:50.763693+0000 mgr.smithi172.nqsqxd (mgr.14199) 292 : audit 0 from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:13:52.611 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:52 smithi172 bash[24902]: cluster 2023-12-07T17:13:51.076546+0000 mgr.smithi172.nqsqxd (mgr.14199) 293 : cluster 0 pgmap v264: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.5 KiB/s rd, 1 op/s 2023-12-07T17:13:54.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:54 smithi172 bash[24902]: cluster 2023-12-07T17:13:53.077283+0000 mgr.smithi172.nqsqxd (mgr.14199) 294 : cluster 0 pgmap v265: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1.2 KiB/s rd, 1 op/s 2023-12-07T17:13:56.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:56 smithi172 bash[24902]: cluster 2023-12-07T17:13:55.077891+0000 mgr.smithi172.nqsqxd (mgr.14199) 295 : cluster 0 pgmap v266: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1023 B/s rd, 0 op/s 2023-12-07T17:13:57.393 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:13:57.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:13:57 smithi172 bash[24902]: cluster 2023-12-07T17:13:57.078718+0000 mgr.smithi172.nqsqxd (mgr.14199) 296 : cluster 0 pgmap v267: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 1023 B/s rd, 0 op/s 2023-12-07T17:14:00.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:00 smithi172 bash[24902]: cluster 2023-12-07T17:13:59.079121+0000 mgr.smithi172.nqsqxd (mgr.14199) 297 : cluster 0 pgmap v268: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:00.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:00 smithi172 bash[24902]: audit 2023-12-07T17:13:59.462918+0000 mon.smithi172 (mon.0) 529 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:14:00.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:00 smithi172 bash[24902]: audit 2023-12-07T17:13:59.989799+0000 mon.smithi172 (mon.0) 530 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:14:00.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:00 smithi172 bash[24902]: audit 2023-12-07T17:13:59.997312+0000 mon.smithi172 (mon.0) 531 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:14:00.745 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:00.745 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:12:59.033960Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:12:59.033137Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:12:59.033413Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:12:59.034235Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:12:59.032853Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:12:59.032524Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:12:59.033687Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:12:59.035048Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:12:59.034864Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:12:59.035735Z", "ports": [8000], "running": 1, "size": 4}}] 2023-12-07T17:14:01.560 INFO:tasks.cephadm:rgw.foo has 1/4 2023-12-07T17:14:02.562 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:02.575 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:02 smithi172 bash[24902]: audit 2023-12-07T17:14:00.734448+0000 mgr.smithi172.nqsqxd (mgr.14199) 298 : audit 0 from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:02.575 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:02 smithi172 bash[24902]: cluster 2023-12-07T17:14:01.079765+0000 mgr.smithi172.nqsqxd (mgr.14199) 299 : cluster 0 pgmap v269: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:04.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:04 smithi172 bash[24902]: cluster 2023-12-07T17:14:03.080263+0000 mgr.smithi172.nqsqxd (mgr.14199) 300 : cluster 0 pgmap v270: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:04.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:04 smithi172 bash[24902]: audit 2023-12-07T17:14:04.084664+0000 mon.smithi172 (mon.0) 532 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:14:06.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:06 smithi172 bash[24902]: cluster 2023-12-07T17:14:05.080820+0000 mgr.smithi172.nqsqxd (mgr.14199) 301 : cluster 0 pgmap v271: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:07.145 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: cluster 2023-12-07T17:14:07.081617+0000 mgr.smithi172.nqsqxd (mgr.14199) 302 : cluster 0 pgmap v272: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: audit 2023-12-07T17:14:07.094373+0000 mon.smithi172 (mon.0) 533 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: audit 2023-12-07T17:14:07.103777+0000 mon.smithi172 (mon.0) 534 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: audit 2023-12-07T17:14:07.672714+0000 mon.smithi172 (mon.0) 535 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: audit 2023-12-07T17:14:07.674564+0000 mon.smithi172 (mon.0) 536 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:14:08.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:08 smithi172 bash[24902]: audit 2023-12-07T17:14:07.683060+0000 mon.smithi172 (mon.0) 537 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:14:09.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:09 smithi172 bash[24902]: cluster 2023-12-07T17:14:07.676726+0000 mgr.smithi172.nqsqxd (mgr.14199) 303 : cluster 0 pgmap v273: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:09.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:09 smithi172 bash[24902]: cluster 2023-12-07T17:14:08.479107+0000 mon.smithi172 (mon.0) 538 : cluster 3 Health check update: 4 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2023-12-07T17:14:10.682 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:10.682 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:14:11.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:11 smithi172 bash[24902]: cluster 2023-12-07T17:14:09.677340+0000 mgr.smithi172.nqsqxd (mgr.14199) 304 : cluster 0 pgmap v274: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:11.484 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:14:12.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:12 smithi172 bash[24902]: audit 2023-12-07T17:14:10.672927+0000 mgr.smithi172.nqsqxd (mgr.14199) 305 : audit 0 from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:12.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:13.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:13 smithi172 bash[24902]: cluster 2023-12-07T17:14:11.678228+0000 mgr.smithi172.nqsqxd (mgr.14199) 306 : cluster 0 pgmap v275: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:15.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:15 smithi172 bash[24902]: cluster 2023-12-07T17:14:13.678888+0000 mgr.smithi172.nqsqxd (mgr.14199) 307 : cluster 0 pgmap v276: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:17.279 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:17.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:17 smithi172 bash[24902]: cluster 2023-12-07T17:14:15.679527+0000 mgr.smithi172.nqsqxd (mgr.14199) 308 : cluster 0 pgmap v277: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:19.357 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:19 smithi172 bash[24902]: cluster 2023-12-07T17:14:17.680336+0000 mgr.smithi172.nqsqxd (mgr.14199) 309 : cluster 0 pgmap v278: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:19.357 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:19 smithi172 bash[24902]: audit 2023-12-07T17:14:19.084593+0000 mon.smithi172 (mon.0) 539 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:14:20.722 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:20.722 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:14:21.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:21 smithi172 bash[24902]: cluster 2023-12-07T17:14:19.681015+0000 mgr.smithi172.nqsqxd (mgr.14199) 310 : cluster 0 pgmap v279: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:21.557 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:14:22.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:22 smithi172 bash[24902]: audit 2023-12-07T17:14:20.713347+0000 mgr.smithi172.nqsqxd (mgr.14199) 311 : audit 0 from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:22.558 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:23.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:23 smithi172 bash[24902]: cluster 2023-12-07T17:14:21.681812+0000 mgr.smithi172.nqsqxd (mgr.14199) 312 : cluster 0 pgmap v280: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:25.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:25 smithi172 bash[24902]: cluster 2023-12-07T17:14:23.682485+0000 mgr.smithi172.nqsqxd (mgr.14199) 313 : cluster 0 pgmap v281: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:27.360 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:27.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:27 smithi172 bash[24902]: cluster 2023-12-07T17:14:25.683093+0000 mgr.smithi172.nqsqxd (mgr.14199) 314 : cluster 0 pgmap v282: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:29.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:29 smithi172 bash[24902]: cluster 2023-12-07T17:14:27.683709+0000 mgr.smithi172.nqsqxd (mgr.14199) 315 : cluster 0 pgmap v283: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:30.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:30.718 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:14:31.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:31 smithi172 bash[24902]: cluster 2023-12-07T17:14:29.684338+0000 mgr.smithi172.nqsqxd (mgr.14199) 316 : cluster 0 pgmap v284: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:31.518 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:14:32.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:32 smithi172 bash[24902]: audit 2023-12-07T17:14:30.708424+0000 mgr.smithi172.nqsqxd (mgr.14199) 317 : audit 0 from='client.14546 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:32.520 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:33.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:33 smithi172 bash[24902]: cluster 2023-12-07T17:14:31.685126+0000 mgr.smithi172.nqsqxd (mgr.14199) 318 : cluster 0 pgmap v285: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:34.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:34 smithi172 bash[24902]: audit 2023-12-07T17:14:34.085889+0000 mon.smithi172 (mon.0) 540 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:14:35.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:35 smithi172 bash[24902]: cluster 2023-12-07T17:14:33.685770+0000 mgr.smithi172.nqsqxd (mgr.14199) 319 : cluster 0 pgmap v286: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:37.310 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:37.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:37 smithi172 bash[24902]: cluster 2023-12-07T17:14:35.686417+0000 mgr.smithi172.nqsqxd (mgr.14199) 320 : cluster 0 pgmap v287: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:39.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:39 smithi172 bash[24902]: cluster 2023-12-07T17:14:37.687178+0000 mgr.smithi172.nqsqxd (mgr.14199) 321 : cluster 0 pgmap v288: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:40.676 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:40.676 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:14:41.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:41 smithi172 bash[24902]: cluster 2023-12-07T17:14:39.687787+0000 mgr.smithi172.nqsqxd (mgr.14199) 322 : cluster 0 pgmap v289: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:41.514 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:14:42.515 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:42.527 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:42 smithi172 bash[24902]: audit 2023-12-07T17:14:40.666954+0000 mgr.smithi172.nqsqxd (mgr.14199) 323 : audit 0 from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:43.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:43 smithi172 bash[24902]: cluster 2023-12-07T17:14:41.688590+0000 mgr.smithi172.nqsqxd (mgr.14199) 324 : cluster 0 pgmap v290: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:45.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:45 smithi172 bash[24902]: cluster 2023-12-07T17:14:43.689242+0000 mgr.smithi172.nqsqxd (mgr.14199) 325 : cluster 0 pgmap v291: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:47.304 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:47.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:47 smithi172 bash[24902]: cluster 2023-12-07T17:14:45.689852+0000 mgr.smithi172.nqsqxd (mgr.14199) 326 : cluster 0 pgmap v292: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:49.395 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:49 smithi172 bash[24902]: cluster 2023-12-07T17:14:47.690534+0000 mgr.smithi172.nqsqxd (mgr.14199) 327 : cluster 0 pgmap v293: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:49.396 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:49 smithi172 bash[24902]: audit 2023-12-07T17:14:49.085160+0000 mon.smithi172 (mon.0) 541 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:14:50.614 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:14:50.615 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:14:51.368 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:14:51.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:51 smithi172 bash[24902]: cluster 2023-12-07T17:14:49.691160+0000 mgr.smithi172.nqsqxd (mgr.14199) 328 : cluster 0 pgmap v294: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:52.369 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:14:52.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:52 smithi172 bash[24902]: audit 2023-12-07T17:14:50.605250+0000 mgr.smithi172.nqsqxd (mgr.14199) 329 : audit 0 from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:14:53.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:53 smithi172 bash[24902]: cluster 2023-12-07T17:14:51.692048+0000 mgr.smithi172.nqsqxd (mgr.14199) 330 : cluster 0 pgmap v295: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:55.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:55 smithi172 bash[24902]: cluster 2023-12-07T17:14:53.692731+0000 mgr.smithi172.nqsqxd (mgr.14199) 331 : cluster 0 pgmap v296: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:57.164 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:14:57.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:57 smithi172 bash[24902]: cluster 2023-12-07T17:14:55.693300+0000 mgr.smithi172.nqsqxd (mgr.14199) 332 : cluster 0 pgmap v297: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:14:59.521 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:14:59 smithi172 bash[24902]: cluster 2023-12-07T17:14:57.694066+0000 mgr.smithi172.nqsqxd (mgr.14199) 333 : cluster 0 pgmap v298: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:00.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:00.741 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:01.393 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:01 smithi172 bash[24902]: cluster 2023-12-07T17:14:59.694759+0000 mgr.smithi172.nqsqxd (mgr.14199) 334 : cluster 0 pgmap v299: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:01.643 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:02.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:02 smithi172 bash[24902]: audit 2023-12-07T17:15:00.732240+0000 mgr.smithi172.nqsqxd (mgr.14199) 335 : audit 0 from='client.14552 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:02.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:03.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:03 smithi172 bash[24902]: cluster 2023-12-07T17:15:01.695496+0000 mgr.smithi172.nqsqxd (mgr.14199) 336 : cluster 0 pgmap v300: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:04.614 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:04 smithi172 bash[24902]: audit 2023-12-07T17:15:04.086262+0000 mon.smithi172 (mon.0) 542 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:15:05.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:05 smithi172 bash[24902]: cluster 2023-12-07T17:15:03.696109+0000 mgr.smithi172.nqsqxd (mgr.14199) 337 : cluster 0 pgmap v301: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:07.439 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:07.468 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:07 smithi172 bash[24902]: cluster 2023-12-07T17:15:05.696736+0000 mgr.smithi172.nqsqxd (mgr.14199) 338 : cluster 0 pgmap v302: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:08.476 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:08 smithi172 bash[24902]: audit 2023-12-07T17:15:07.728269+0000 mon.smithi172 (mon.0) 543 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:15:09.418 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:09 smithi172 bash[24902]: cluster 2023-12-07T17:15:07.697484+0000 mgr.smithi172.nqsqxd (mgr.14199) 339 : cluster 0 pgmap v303: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:10.942 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:10.942 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:14:07.084920Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:14:07.084014Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:14:07.084320Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:14:07.085220Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:14:07.083698Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:14:07.083336Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:14:07.084621Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:14:07.086122Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:14:07.085821Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:14:07.087268Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:11.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:11 smithi172 bash[24902]: cluster 2023-12-07T17:15:09.698035+0000 mgr.smithi172.nqsqxd (mgr.14199) 340 : cluster 0 pgmap v304: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:11.744 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:12.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:12 smithi172 bash[24902]: audit 2023-12-07T17:15:10.933964+0000 mgr.smithi172.nqsqxd (mgr.14199) 341 : audit 0 from='client.14554 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:12.746 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:13.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:13 smithi172 bash[24902]: cluster 2023-12-07T17:15:11.698853+0000 mgr.smithi172.nqsqxd (mgr.14199) 342 : cluster 0 pgmap v305: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:15.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:15 smithi172 bash[24902]: cluster 2023-12-07T17:15:13.699322+0000 mgr.smithi172.nqsqxd (mgr.14199) 343 : cluster 0 pgmap v306: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:16 smithi172 bash[24902]: audit 2023-12-07T17:15:15.226131+0000 mon.smithi172 (mon.0) 544 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:15:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:16 smithi172 bash[24902]: audit 2023-12-07T17:15:15.234218+0000 mon.smithi172 (mon.0) 545 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:15:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:16 smithi172 bash[24902]: audit 2023-12-07T17:15:15.806803+0000 mon.smithi172 (mon.0) 546 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:15:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:16 smithi172 bash[24902]: audit 2023-12-07T17:15:15.807885+0000 mon.smithi172 (mon.0) 547 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:15:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:16 smithi172 bash[24902]: audit 2023-12-07T17:15:15.814361+0000 mon.smithi172 (mon.0) 548 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:15:17.327 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:17.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:17 smithi172 bash[24902]: cluster 2023-12-07T17:15:15.699892+0000 mgr.smithi172.nqsqxd (mgr.14199) 344 : cluster 0 pgmap v307: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:17.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:17 smithi172 bash[24902]: cluster 2023-12-07T17:15:15.809476+0000 mgr.smithi172.nqsqxd (mgr.14199) 345 : cluster 0 pgmap v308: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:17.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:17 smithi172 bash[24902]: cluster 2023-12-07T17:15:15.809708+0000 mgr.smithi172.nqsqxd (mgr.14199) 346 : cluster 0 pgmap v309: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:19.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:19 smithi172 bash[24902]: cluster 2023-12-07T17:15:17.810416+0000 mgr.smithi172.nqsqxd (mgr.14199) 347 : cluster 0 pgmap v310: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:19.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:19 smithi172 bash[24902]: audit 2023-12-07T17:15:19.086448+0000 mon.smithi172 (mon.0) 549 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:15:20.690 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:20.690 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:21.527 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:21 smithi172 bash[24902]: cluster 2023-12-07T17:15:19.811043+0000 mgr.smithi172.nqsqxd (mgr.14199) 348 : cluster 0 pgmap v311: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:21.528 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:22.529 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:22.544 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:22 smithi172 bash[24902]: audit 2023-12-07T17:15:20.681189+0000 mgr.smithi172.nqsqxd (mgr.14199) 349 : audit 0 from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:23.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:23 smithi172 bash[24902]: cluster 2023-12-07T17:15:21.811839+0000 mgr.smithi172.nqsqxd (mgr.14199) 350 : cluster 0 pgmap v312: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:25.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:25 smithi172 bash[24902]: cluster 2023-12-07T17:15:23.812425+0000 mgr.smithi172.nqsqxd (mgr.14199) 351 : cluster 0 pgmap v313: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:27.323 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:27.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:27 smithi172 bash[24902]: cluster 2023-12-07T17:15:25.813108+0000 mgr.smithi172.nqsqxd (mgr.14199) 352 : cluster 0 pgmap v314: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:29.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:29 smithi172 bash[24902]: cluster 2023-12-07T17:15:27.813927+0000 mgr.smithi172.nqsqxd (mgr.14199) 353 : cluster 0 pgmap v315: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:30.775 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:30.775 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:31.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:31 smithi172 bash[24902]: cluster 2023-12-07T17:15:29.814629+0000 mgr.smithi172.nqsqxd (mgr.14199) 354 : cluster 0 pgmap v316: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:31.559 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:32.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:32.574 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:32 smithi172 bash[24902]: audit 2023-12-07T17:15:30.763778+0000 mgr.smithi172.nqsqxd (mgr.14199) 355 : audit 0 from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:33.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:33 smithi172 bash[24902]: cluster 2023-12-07T17:15:31.815427+0000 mgr.smithi172.nqsqxd (mgr.14199) 356 : cluster 0 pgmap v317: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:34.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:34 smithi172 bash[24902]: audit 2023-12-07T17:15:34.087058+0000 mon.smithi172 (mon.0) 550 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:15:35.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:35 smithi172 bash[24902]: cluster 2023-12-07T17:15:33.816068+0000 mgr.smithi172.nqsqxd (mgr.14199) 357 : cluster 0 pgmap v318: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:37.352 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:37.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:37 smithi172 bash[24902]: cluster 2023-12-07T17:15:35.816632+0000 mgr.smithi172.nqsqxd (mgr.14199) 358 : cluster 0 pgmap v319: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:39.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:39 smithi172 bash[24902]: cluster 2023-12-07T17:15:37.817455+0000 mgr.smithi172.nqsqxd (mgr.14199) 359 : cluster 0 pgmap v320: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:40.584 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:40.584 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:41.370 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:41.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:41 smithi172 bash[24902]: cluster 2023-12-07T17:15:39.818132+0000 mgr.smithi172.nqsqxd (mgr.14199) 360 : cluster 0 pgmap v321: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:42.371 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:42.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:42 smithi172 bash[24902]: audit 2023-12-07T17:15:40.574344+0000 mgr.smithi172.nqsqxd (mgr.14199) 361 : audit 0 from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:43.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:43 smithi172 bash[24902]: cluster 2023-12-07T17:15:41.818980+0000 mgr.smithi172.nqsqxd (mgr.14199) 362 : cluster 0 pgmap v322: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:45.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:45 smithi172 bash[24902]: cluster 2023-12-07T17:15:43.819610+0000 mgr.smithi172.nqsqxd (mgr.14199) 363 : cluster 0 pgmap v323: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:47.168 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:47.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:47 smithi172 bash[24902]: cluster 2023-12-07T17:15:45.820259+0000 mgr.smithi172.nqsqxd (mgr.14199) 364 : cluster 0 pgmap v324: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:49.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:49 smithi172 bash[24902]: cluster 2023-12-07T17:15:47.820945+0000 mgr.smithi172.nqsqxd (mgr.14199) 365 : cluster 0 pgmap v325: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:49.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:49 smithi172 bash[24902]: audit 2023-12-07T17:15:49.087102+0000 mon.smithi172 (mon.0) 551 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:15:50.228 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:15:50.228 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:15:51.020 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:15:51.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:51 smithi172 bash[24902]: cluster 2023-12-07T17:15:49.821543+0000 mgr.smithi172.nqsqxd (mgr.14199) 366 : cluster 0 pgmap v326: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:51.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:51 smithi172 bash[24902]: audit 2023-12-07T17:15:50.222942+0000 mgr.smithi172.nqsqxd (mgr.14199) 367 : audit 0 from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:15:52.022 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:15:52.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:52 smithi172 bash[24902]: cluster 2023-12-07T17:15:51.822366+0000 mgr.smithi172.nqsqxd (mgr.14199) 368 : cluster 0 pgmap v327: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:55.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:54 smithi172 bash[24902]: cluster 2023-12-07T17:15:53.822926+0000 mgr.smithi172.nqsqxd (mgr.14199) 369 : cluster 0 pgmap v328: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:56.819 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:15:57.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:56 smithi172 bash[24902]: cluster 2023-12-07T17:15:55.823561+0000 mgr.smithi172.nqsqxd (mgr.14199) 370 : cluster 0 pgmap v329: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:15:59.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:15:58 smithi172 bash[24902]: cluster 2023-12-07T17:15:57.824408+0000 mgr.smithi172.nqsqxd (mgr.14199) 371 : cluster 0 pgmap v330: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:00.151 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:00.151 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:00.982 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:00 smithi172 bash[24902]: cluster 2023-12-07T17:15:59.825034+0000 mgr.smithi172.nqsqxd (mgr.14199) 372 : cluster 0 pgmap v331: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:00.983 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:00 smithi172 bash[24902]: audit 2023-12-07T17:16:00.145828+0000 mgr.smithi172.nqsqxd (mgr.14199) 373 : audit 0 from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:00.984 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:01.985 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:02.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:02 smithi172 bash[24902]: cluster 2023-12-07T17:16:01.825796+0000 mgr.smithi172.nqsqxd (mgr.14199) 374 : cluster 0 pgmap v332: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:05.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:04 smithi172 bash[24902]: cluster 2023-12-07T17:16:03.826359+0000 mgr.smithi172.nqsqxd (mgr.14199) 375 : cluster 0 pgmap v333: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:05.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:04 smithi172 bash[24902]: audit 2023-12-07T17:16:04.087791+0000 mon.smithi172 (mon.0) 552 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:16:06.771 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:07.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:06 smithi172 bash[24902]: cluster 2023-12-07T17:16:05.826786+0000 mgr.smithi172.nqsqxd (mgr.14199) 376 : cluster 0 pgmap v334: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:09.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:08 smithi172 bash[24902]: cluster 2023-12-07T17:16:07.827287+0000 mgr.smithi172.nqsqxd (mgr.14199) 377 : cluster 0 pgmap v335: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:10.096 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:10.878 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:11.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:10 smithi172 bash[24902]: cluster 2023-12-07T17:16:09.827865+0000 mgr.smithi172.nqsqxd (mgr.14199) 378 : cluster 0 pgmap v336: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:11.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:10 smithi172 bash[24902]: audit 2023-12-07T17:16:10.086875+0000 mgr.smithi172.nqsqxd (mgr.14199) 379 : audit 0 from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:11.879 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:12.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:12 smithi172 bash[24902]: cluster 2023-12-07T17:16:11.828666+0000 mgr.smithi172.nqsqxd (mgr.14199) 380 : cluster 0 pgmap v337: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:15.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:14 smithi172 bash[24902]: cluster 2023-12-07T17:16:13.829221+0000 mgr.smithi172.nqsqxd (mgr.14199) 381 : cluster 0 pgmap v338: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:16.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:15 smithi172 bash[24902]: audit 2023-12-07T17:16:15.863601+0000 mon.smithi172 (mon.0) 553 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:16:16.669 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:17.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:16 smithi172 bash[24902]: cluster 2023-12-07T17:16:15.829928+0000 mgr.smithi172.nqsqxd (mgr.14199) 382 : cluster 0 pgmap v339: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:17.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:16 smithi172 bash[24902]: audit 2023-12-07T17:16:16.488487+0000 mon.smithi172 (mon.0) 554 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:16:17.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:16 smithi172 bash[24902]: audit 2023-12-07T17:16:16.490251+0000 mon.smithi172 (mon.0) 555 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:16:17.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:16 smithi172 bash[24902]: audit 2023-12-07T17:16:16.499252+0000 mon.smithi172 (mon.0) 556 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:18.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:17 smithi172 bash[24902]: cluster 2023-12-07T17:16:16.493236+0000 mgr.smithi172.nqsqxd (mgr.14199) 383 : cluster 0 pgmap v340: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:18.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:17 smithi172 bash[24902]: cluster 2023-12-07T17:16:16.493766+0000 mgr.smithi172.nqsqxd (mgr.14199) 384 : cluster 0 pgmap v341: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:20.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:19 smithi172 bash[24902]: cluster 2023-12-07T17:16:18.494351+0000 mgr.smithi172.nqsqxd (mgr.14199) 385 : cluster 0 pgmap v342: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:20.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:19 smithi172 bash[24902]: audit 2023-12-07T17:16:19.087906+0000 mon.smithi172 (mon.0) 557 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:16:20.202 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:20.202 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:21.080 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:21.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:20 smithi172 bash[24902]: audit 2023-12-07T17:16:20.193133+0000 mgr.smithi172.nqsqxd (mgr.14199) 386 : audit 0 from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:22.081 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:22.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:21 smithi172 bash[24902]: cluster 2023-12-07T17:16:20.495005+0000 mgr.smithi172.nqsqxd (mgr.14199) 387 : cluster 0 pgmap v343: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:24.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:23 smithi172 bash[24902]: cluster 2023-12-07T17:16:22.495857+0000 mgr.smithi172.nqsqxd (mgr.14199) 388 : cluster 0 pgmap v344: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:26.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:25 smithi172 bash[24902]: cluster 2023-12-07T17:16:24.496555+0000 mgr.smithi172.nqsqxd (mgr.14199) 389 : cluster 0 pgmap v345: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:26.874 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:28.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:27 smithi172 bash[24902]: cluster 2023-12-07T17:16:26.497364+0000 mgr.smithi172.nqsqxd (mgr.14199) 390 : cluster 0 pgmap v346: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:30.036 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:30.036 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:30.270 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:29 smithi172 bash[24902]: cluster 2023-12-07T17:16:28.498004+0000 mgr.smithi172.nqsqxd (mgr.14199) 391 : cluster 0 pgmap v347: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:30.809 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:31.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:30 smithi172 bash[24902]: audit 2023-12-07T17:16:30.026873+0000 mgr.smithi172.nqsqxd (mgr.14199) 392 : audit 0 from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:31.810 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:32.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:31 smithi172 bash[24902]: cluster 2023-12-07T17:16:30.498692+0000 mgr.smithi172.nqsqxd (mgr.14199) 393 : cluster 0 pgmap v348: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:34.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:33 smithi172 bash[24902]: cluster 2023-12-07T17:16:32.499435+0000 mgr.smithi172.nqsqxd (mgr.14199) 394 : cluster 0 pgmap v349: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:35.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:34 smithi172 bash[24902]: audit 2023-12-07T17:16:34.088485+0000 mon.smithi172 (mon.0) 558 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:16:36.343 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:35 smithi172 bash[24902]: cluster 2023-12-07T17:16:34.499993+0000 mgr.smithi172.nqsqxd (mgr.14199) 395 : cluster 0 pgmap v350: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:36.606 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:38.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:37 smithi172 bash[24902]: cluster 2023-12-07T17:16:36.500828+0000 mgr.smithi172.nqsqxd (mgr.14199) 396 : cluster 0 pgmap v351: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:39.835 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:39.835 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:40.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:39 smithi172 bash[24902]: cluster 2023-12-07T17:16:38.501421+0000 mgr.smithi172.nqsqxd (mgr.14199) 397 : cluster 0 pgmap v352: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:40.658 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:41.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:40 smithi172 bash[24902]: audit 2023-12-07T17:16:39.826950+0000 mgr.smithi172.nqsqxd (mgr.14199) 398 : audit 0 from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:41.659 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:42.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:41 smithi172 bash[24902]: cluster 2023-12-07T17:16:40.502108+0000 mgr.smithi172.nqsqxd (mgr.14199) 399 : cluster 0 pgmap v353: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:44.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:43 smithi172 bash[24902]: cluster 2023-12-07T17:16:42.503050+0000 mgr.smithi172.nqsqxd (mgr.14199) 400 : cluster 0 pgmap v354: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:46.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:45 smithi172 bash[24902]: cluster 2023-12-07T17:16:44.503719+0000 mgr.smithi172.nqsqxd (mgr.14199) 401 : cluster 0 pgmap v355: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:46.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:45 smithi172 bash[24902]: audit 2023-12-07T17:16:45.354004+0000 mon.smithi172 (mon.0) 559 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:46.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:45 smithi172 bash[24902]: audit 2023-12-07T17:16:45.919352+0000 mon.smithi172 (mon.0) 560 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:46.448 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: audit 2023-12-07T17:16:45.345355+0000 mgr.smithi172.nqsqxd (mgr.14199) 402 : audit 0 from='client.14574 -' entity='client.crash.smithi172' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: cluster 2023-12-07T17:16:45.355377+0000 mgr.smithi172.nqsqxd (mgr.14199) 403 : cluster 0 pgmap v356: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: audit 2023-12-07T17:16:45.913851+0000 mgr.smithi172.nqsqxd (mgr.14199) 404 : audit 0 from='client.14576 -' entity='client.crash.smithi172' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: cluster 2023-12-07T17:16:45.920739+0000 mgr.smithi172.nqsqxd (mgr.14199) 405 : cluster 0 pgmap v357: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: cluster 2023-12-07T17:16:46.350385+0000 mon.smithi172 (mon.0) 561 : cluster 3 Health check failed: 2 daemons have recently crashed (RECENT_CRASH) 2023-12-07T17:16:47.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:46 smithi172 bash[24902]: audit 2023-12-07T17:16:46.489403+0000 mon.smithi172 (mon.0) 562 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:48.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:48 smithi172 bash[24902]: audit 2023-12-07T17:16:46.482883+0000 mgr.smithi172.nqsqxd (mgr.14199) 406 : audit 0 from='client.14578 -' entity='client.crash.smithi172' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:16:48.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:48 smithi172 bash[24902]: cluster 2023-12-07T17:16:46.490594+0000 mgr.smithi172.nqsqxd (mgr.14199) 407 : cluster 0 pgmap v358: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:48.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:48 smithi172 bash[24902]: audit 2023-12-07T17:16:47.007782+0000 mgr.smithi172.nqsqxd (mgr.14199) 408 : audit 0 from='client.14580 -' entity='client.crash.smithi172' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2023-12-07T17:16:48.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:48 smithi172 bash[24902]: audit 2023-12-07T17:16:47.015071+0000 mon.smithi172 (mon.0) 563 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:48.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:48 smithi172 bash[24902]: cluster 2023-12-07T17:16:47.016153+0000 mgr.smithi172.nqsqxd (mgr.14199) 409 : cluster 0 pgmap v359: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:49.837 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:49.837 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:16:50.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:50 smithi172 bash[24902]: cluster 2023-12-07T17:16:49.016784+0000 mgr.smithi172.nqsqxd (mgr.14199) 410 : cluster 0 pgmap v360: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:50.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:50 smithi172 bash[24902]: audit 2023-12-07T17:16:49.095032+0000 mon.smithi172 (mon.0) 564 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:16:50.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:50 smithi172 bash[24902]: audit 2023-12-07T17:16:49.096184+0000 mon.smithi172 (mon.0) 565 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:16:50.556 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:16:51.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:51 smithi172 bash[24902]: audit 2023-12-07T17:16:49.828238+0000 mgr.smithi172.nqsqxd (mgr.14199) 411 : audit 0 from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:16:51.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:16:52.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:52 smithi172 bash[24902]: cluster 2023-12-07T17:16:51.017477+0000 mgr.smithi172.nqsqxd (mgr.14199) 412 : cluster 0 pgmap v361: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:52.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:52 smithi172 bash[24902]: cluster 2023-12-07T17:16:51.533210+0000 mon.smithi172 (mon.0) 566 : cluster 3 Health check update: 4 daemons have recently crashed (RECENT_CRASH) 2023-12-07T17:16:54.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:54 smithi172 bash[24902]: cluster 2023-12-07T17:16:53.018315+0000 mgr.smithi172.nqsqxd (mgr.14199) 413 : cluster 0 pgmap v362: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:56.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:56 smithi172 bash[24902]: cluster 2023-12-07T17:16:55.019025+0000 mgr.smithi172.nqsqxd (mgr.14199) 414 : cluster 0 pgmap v363: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:56.378 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:16:57.872 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:16:57 smithi172 bash[24902]: cluster 2023-12-07T17:16:57.019873+0000 mgr.smithi172.nqsqxd (mgr.14199) 415 : cluster 0 pgmap v364: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:16:59.641 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:16:59.641 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:00.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:00 smithi172 bash[24902]: cluster 2023-12-07T17:16:59.020468+0000 mgr.smithi172.nqsqxd (mgr.14199) 416 : cluster 0 pgmap v365: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:00.419 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:01.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:01 smithi172 bash[24902]: audit 2023-12-07T17:16:59.632064+0000 mgr.smithi172.nqsqxd (mgr.14199) 417 : audit 0 from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:01.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:02.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:02 smithi172 bash[24902]: cluster 2023-12-07T17:17:01.021157+0000 mgr.smithi172.nqsqxd (mgr.14199) 418 : cluster 0 pgmap v366: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:04.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:04 smithi172 bash[24902]: cluster 2023-12-07T17:17:03.021957+0000 mgr.smithi172.nqsqxd (mgr.14199) 419 : cluster 0 pgmap v367: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:05.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:05 smithi172 bash[24902]: audit 2023-12-07T17:17:04.089098+0000 mon.smithi172 (mon.0) 567 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:17:06.223 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:06.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:06 smithi172 bash[24902]: cluster 2023-12-07T17:17:05.022564+0000 mgr.smithi172.nqsqxd (mgr.14199) 420 : cluster 0 pgmap v368: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:07.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:07 smithi172 bash[24902]: cluster 2023-12-07T17:17:07.023333+0000 mgr.smithi172.nqsqxd (mgr.14199) 421 : cluster 0 pgmap v369: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:09.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:09.668 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:10.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:10 smithi172 bash[24902]: cluster 2023-12-07T17:17:09.024009+0000 mgr.smithi172.nqsqxd (mgr.14199) 422 : cluster 0 pgmap v370: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:10.446 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:11.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:11 smithi172 bash[24902]: audit 2023-12-07T17:17:09.656024+0000 mgr.smithi172.nqsqxd (mgr.14199) 423 : audit 0 from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:11.447 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:12.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:12 smithi172 bash[24902]: cluster 2023-12-07T17:17:11.024659+0000 mgr.smithi172.nqsqxd (mgr.14199) 424 : cluster 0 pgmap v371: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:14.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:14 smithi172 bash[24902]: cluster 2023-12-07T17:17:13.025499+0000 mgr.smithi172.nqsqxd (mgr.14199) 425 : cluster 0 pgmap v372: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:16.246 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:16.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:16 smithi172 bash[24902]: cluster 2023-12-07T17:17:15.026212+0000 mgr.smithi172.nqsqxd (mgr.14199) 426 : cluster 0 pgmap v373: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:17.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: audit 2023-12-07T17:17:16.550234+0000 mon.smithi172 (mon.0) 568 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:17:17.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: cluster 2023-12-07T17:17:17.026690+0000 mgr.smithi172.nqsqxd (mgr.14199) 427 : cluster 0 pgmap v374: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: audit 2023-12-07T17:17:17.176797+0000 mon.smithi172 (mon.0) 569 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:17:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: audit 2023-12-07T17:17:17.178244+0000 mon.smithi172 (mon.0) 570 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:17:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: cluster 2023-12-07T17:17:17.180481+0000 mgr.smithi172.nqsqxd (mgr.14199) 428 : cluster 0 pgmap v375: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: cluster 2023-12-07T17:17:17.180763+0000 mgr.smithi172.nqsqxd (mgr.14199) 429 : cluster 0 pgmap v376: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:17 smithi172 bash[24902]: audit 2023-12-07T17:17:17.184653+0000 mon.smithi172 (mon.0) 571 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:17:19.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:19 smithi172 bash[24902]: audit 2023-12-07T17:17:19.089060+0000 mon.smithi172 (mon.0) 572 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:17:19.590 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:19.591 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:20.364 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:20.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:20 smithi172 bash[24902]: cluster 2023-12-07T17:17:19.181337+0000 mgr.smithi172.nqsqxd (mgr.14199) 430 : cluster 0 pgmap v377: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:21.365 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:21.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:21 smithi172 bash[24902]: audit 2023-12-07T17:17:19.585539+0000 mgr.smithi172.nqsqxd (mgr.14199) 431 : audit 0 from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:22.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:22 smithi172 bash[24902]: cluster 2023-12-07T17:17:21.182101+0000 mgr.smithi172.nqsqxd (mgr.14199) 432 : cluster 0 pgmap v378: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:24.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:24 smithi172 bash[24902]: cluster 2023-12-07T17:17:23.182796+0000 mgr.smithi172.nqsqxd (mgr.14199) 433 : cluster 0 pgmap v379: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:26.163 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:26.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:26 smithi172 bash[24902]: cluster 2023-12-07T17:17:25.183361+0000 mgr.smithi172.nqsqxd (mgr.14199) 434 : cluster 0 pgmap v380: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:27.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:27 smithi172 bash[24902]: cluster 2023-12-07T17:17:27.184157+0000 mgr.smithi172.nqsqxd (mgr.14199) 435 : cluster 0 pgmap v381: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:29.511 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:29.511 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:30.255 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:30.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:30 smithi172 bash[24902]: cluster 2023-12-07T17:17:29.184596+0000 mgr.smithi172.nqsqxd (mgr.14199) 436 : cluster 0 pgmap v382: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:31.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:31.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:31 smithi172 bash[24902]: audit 2023-12-07T17:17:29.502499+0000 mgr.smithi172.nqsqxd (mgr.14199) 437 : audit 0 from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:32 smithi172 bash[24902]: cluster 2023-12-07T17:17:31.185324+0000 mgr.smithi172.nqsqxd (mgr.14199) 438 : cluster 0 pgmap v383: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:34.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:34 smithi172 bash[24902]: cluster 2023-12-07T17:17:33.186041+0000 mgr.smithi172.nqsqxd (mgr.14199) 439 : cluster 0 pgmap v384: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:34 smithi172 bash[24902]: audit 2023-12-07T17:17:34.090114+0000 mon.smithi172 (mon.0) 573 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:17:36.048 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:36.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:36 smithi172 bash[24902]: cluster 2023-12-07T17:17:35.186778+0000 mgr.smithi172.nqsqxd (mgr.14199) 440 : cluster 0 pgmap v385: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:37.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:37 smithi172 bash[24902]: cluster 2023-12-07T17:17:37.187500+0000 mgr.smithi172.nqsqxd (mgr.14199) 441 : cluster 0 pgmap v386: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:39.479 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:39.479 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:40.282 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:40.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:40 smithi172 bash[24902]: cluster 2023-12-07T17:17:39.188121+0000 mgr.smithi172.nqsqxd (mgr.14199) 442 : cluster 0 pgmap v387: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:41.283 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:41.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:41 smithi172 bash[24902]: audit 2023-12-07T17:17:39.469841+0000 mgr.smithi172.nqsqxd (mgr.14199) 443 : audit 0 from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:42.556 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:42 smithi172 bash[24902]: cluster 2023-12-07T17:17:41.188867+0000 mgr.smithi172.nqsqxd (mgr.14199) 444 : cluster 0 pgmap v388: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:44.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:44 smithi172 bash[24902]: cluster 2023-12-07T17:17:43.189523+0000 mgr.smithi172.nqsqxd (mgr.14199) 445 : cluster 0 pgmap v389: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:46.076 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:46.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:46 smithi172 bash[24902]: cluster 2023-12-07T17:17:45.190163+0000 mgr.smithi172.nqsqxd (mgr.14199) 446 : cluster 0 pgmap v390: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:47.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:47 smithi172 bash[24902]: cluster 2023-12-07T17:17:47.191207+0000 mgr.smithi172.nqsqxd (mgr.14199) 447 : cluster 0 pgmap v391: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:49.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:49 smithi172 bash[24902]: audit 2023-12-07T17:17:49.090450+0000 mon.smithi172 (mon.0) 574 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:17:49.491 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:49.491 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:17:50.227 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:17:50.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:50 smithi172 bash[24902]: cluster 2023-12-07T17:17:49.191845+0000 mgr.smithi172.nqsqxd (mgr.14199) 448 : cluster 0 pgmap v392: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:51.228 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:17:51.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:51 smithi172 bash[24902]: audit 2023-12-07T17:17:49.486086+0000 mgr.smithi172.nqsqxd (mgr.14199) 449 : audit 0 from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:17:52.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:52 smithi172 bash[24902]: cluster 2023-12-07T17:17:51.192642+0000 mgr.smithi172.nqsqxd (mgr.14199) 450 : cluster 0 pgmap v393: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:54.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:54 smithi172 bash[24902]: cluster 2023-12-07T17:17:53.193309+0000 mgr.smithi172.nqsqxd (mgr.14199) 451 : cluster 0 pgmap v394: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:56.017 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:17:56.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:56 smithi172 bash[24902]: cluster 2023-12-07T17:17:55.193944+0000 mgr.smithi172.nqsqxd (mgr.14199) 452 : cluster 0 pgmap v395: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:57.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:17:57 smithi172 bash[24902]: cluster 2023-12-07T17:17:57.194777+0000 mgr.smithi172.nqsqxd (mgr.14199) 453 : cluster 0 pgmap v396: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:17:59.379 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:17:59.379 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:00.180 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:00.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:00 smithi172 bash[24902]: cluster 2023-12-07T17:17:59.195361+0000 mgr.smithi172.nqsqxd (mgr.14199) 454 : cluster 0 pgmap v397: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:01.181 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:01.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:01 smithi172 bash[24902]: audit 2023-12-07T17:17:59.368772+0000 mgr.smithi172.nqsqxd (mgr.14199) 455 : audit 0 from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:02.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:02 smithi172 bash[24902]: cluster 2023-12-07T17:18:01.196053+0000 mgr.smithi172.nqsqxd (mgr.14199) 456 : cluster 0 pgmap v398: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:04.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:04 smithi172 bash[24902]: cluster 2023-12-07T17:18:03.196679+0000 mgr.smithi172.nqsqxd (mgr.14199) 457 : cluster 0 pgmap v399: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:04.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:04 smithi172 bash[24902]: audit 2023-12-07T17:18:04.091028+0000 mon.smithi172 (mon.0) 575 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:18:05.976 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:06.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:06 smithi172 bash[24902]: cluster 2023-12-07T17:18:05.197365+0000 mgr.smithi172.nqsqxd (mgr.14199) 458 : cluster 0 pgmap v400: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:07.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:07 smithi172 bash[24902]: cluster 2023-12-07T17:18:07.198133+0000 mgr.smithi172.nqsqxd (mgr.14199) 459 : cluster 0 pgmap v401: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:09.527 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:09.527 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:10.378 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:10.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:10 smithi172 bash[24902]: cluster 2023-12-07T17:18:09.198923+0000 mgr.smithi172.nqsqxd (mgr.14199) 460 : cluster 0 pgmap v402: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:11.379 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:11.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:11 smithi172 bash[24902]: audit 2023-12-07T17:18:09.519279+0000 mgr.smithi172.nqsqxd (mgr.14199) 461 : audit 0 from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:12.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:12 smithi172 bash[24902]: cluster 2023-12-07T17:18:11.199729+0000 mgr.smithi172.nqsqxd (mgr.14199) 462 : cluster 0 pgmap v403: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:14.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:14 smithi172 bash[24902]: cluster 2023-12-07T17:18:13.200336+0000 mgr.smithi172.nqsqxd (mgr.14199) 463 : cluster 0 pgmap v404: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:16.175 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:16.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:16 smithi172 bash[24902]: cluster 2023-12-07T17:18:15.200968+0000 mgr.smithi172.nqsqxd (mgr.14199) 464 : cluster 0 pgmap v405: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:17.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:17 smithi172 bash[24902]: cluster 2023-12-07T17:18:17.203534+0000 mgr.smithi172.nqsqxd (mgr.14199) 465 : cluster 0 pgmap v406: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:17.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:17 smithi172 bash[24902]: audit 2023-12-07T17:18:17.228626+0000 mon.smithi172 (mon.0) 576 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:18:18.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:18 smithi172 bash[24902]: audit 2023-12-07T17:18:17.797672+0000 mon.smithi172 (mon.0) 577 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:18:18.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:18 smithi172 bash[24902]: audit 2023-12-07T17:18:17.798810+0000 mon.smithi172 (mon.0) 578 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:18:18.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:18 smithi172 bash[24902]: cluster 2023-12-07T17:18:17.800828+0000 mgr.smithi172.nqsqxd (mgr.14199) 466 : cluster 0 pgmap v407: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:18.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:18 smithi172 bash[24902]: cluster 2023-12-07T17:18:17.801346+0000 mgr.smithi172.nqsqxd (mgr.14199) 467 : cluster 0 pgmap v408: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:18.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:18 smithi172 bash[24902]: audit 2023-12-07T17:18:17.806324+0000 mon.smithi172 (mon.0) 579 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:18:19.777 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:19.777 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:19.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:19 smithi172 bash[24902]: audit 2023-12-07T17:18:19.091579+0000 mon.smithi172 (mon.0) 580 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:18:20.550 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:20.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:20 smithi172 bash[24902]: audit 2023-12-07T17:18:19.772116+0000 mgr.smithi172.nqsqxd (mgr.14199) 468 : audit 0 from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:20.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:20 smithi172 bash[24902]: cluster 2023-12-07T17:18:19.801806+0000 mgr.smithi172.nqsqxd (mgr.14199) 469 : cluster 0 pgmap v409: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:21.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:22.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:22 smithi172 bash[24902]: cluster 2023-12-07T17:18:21.802632+0000 mgr.smithi172.nqsqxd (mgr.14199) 470 : cluster 0 pgmap v410: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:25.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:24 smithi172 bash[24902]: cluster 2023-12-07T17:18:23.803133+0000 mgr.smithi172.nqsqxd (mgr.14199) 471 : cluster 0 pgmap v411: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:26.346 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:27.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:26 smithi172 bash[24902]: cluster 2023-12-07T17:18:25.803774+0000 mgr.smithi172.nqsqxd (mgr.14199) 472 : cluster 0 pgmap v412: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:29.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:28 smithi172 bash[24902]: cluster 2023-12-07T17:18:27.804329+0000 mgr.smithi172.nqsqxd (mgr.14199) 473 : cluster 0 pgmap v413: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:29.620 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:29.621 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:30.466 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:31.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:30 smithi172 bash[24902]: audit 2023-12-07T17:18:29.615277+0000 mgr.smithi172.nqsqxd (mgr.14199) 474 : audit 0 from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:31.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:30 smithi172 bash[24902]: cluster 2023-12-07T17:18:29.804976+0000 mgr.smithi172.nqsqxd (mgr.14199) 475 : cluster 0 pgmap v414: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:31.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:32.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:32 smithi172 bash[24902]: cluster 2023-12-07T17:18:31.805831+0000 mgr.smithi172.nqsqxd (mgr.14199) 476 : cluster 0 pgmap v415: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:35.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:34 smithi172 bash[24902]: cluster 2023-12-07T17:18:33.806507+0000 mgr.smithi172.nqsqxd (mgr.14199) 477 : cluster 0 pgmap v416: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:35.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:34 smithi172 bash[24902]: audit 2023-12-07T17:18:34.091882+0000 mon.smithi172 (mon.0) 581 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:18:36.260 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:37.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:36 smithi172 bash[24902]: cluster 2023-12-07T17:18:35.807130+0000 mgr.smithi172.nqsqxd (mgr.14199) 478 : cluster 0 pgmap v417: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:38.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:38 smithi172 bash[24902]: cluster 2023-12-07T17:18:37.808088+0000 mgr.smithi172.nqsqxd (mgr.14199) 479 : cluster 0 pgmap v418: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:39.570 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:39.570 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:40.384 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:41.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:40 smithi172 bash[24902]: audit 2023-12-07T17:18:39.561221+0000 mgr.smithi172.nqsqxd (mgr.14199) 480 : audit 0 from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:41.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:40 smithi172 bash[24902]: cluster 2023-12-07T17:18:39.808808+0000 mgr.smithi172.nqsqxd (mgr.14199) 481 : cluster 0 pgmap v419: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:41.385 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:42.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:42 smithi172 bash[24902]: cluster 2023-12-07T17:18:41.809791+0000 mgr.smithi172.nqsqxd (mgr.14199) 482 : cluster 0 pgmap v420: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:45.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:44 smithi172 bash[24902]: cluster 2023-12-07T17:18:43.810532+0000 mgr.smithi172.nqsqxd (mgr.14199) 483 : cluster 0 pgmap v421: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:46.175 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:47.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:46 smithi172 bash[24902]: cluster 2023-12-07T17:18:45.811319+0000 mgr.smithi172.nqsqxd (mgr.14199) 484 : cluster 0 pgmap v422: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:49.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:48 smithi172 bash[24902]: cluster 2023-12-07T17:18:47.812241+0000 mgr.smithi172.nqsqxd (mgr.14199) 485 : cluster 0 pgmap v423: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:49.447 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:49.447 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:49 smithi172 bash[24902]: audit 2023-12-07T17:18:49.091549+0000 mon.smithi172 (mon.0) 582 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:18:50.283 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:18:51.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:50 smithi172 bash[24902]: audit 2023-12-07T17:18:49.437475+0000 mgr.smithi172.nqsqxd (mgr.14199) 486 : audit 0 from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:18:51.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:50 smithi172 bash[24902]: cluster 2023-12-07T17:18:49.812895+0000 mgr.smithi172.nqsqxd (mgr.14199) 487 : cluster 0 pgmap v424: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:51.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:18:52.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:52 smithi172 bash[24902]: cluster 2023-12-07T17:18:51.813864+0000 mgr.smithi172.nqsqxd (mgr.14199) 488 : cluster 0 pgmap v425: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:55.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:54 smithi172 bash[24902]: cluster 2023-12-07T17:18:53.814682+0000 mgr.smithi172.nqsqxd (mgr.14199) 489 : cluster 0 pgmap v426: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:56.076 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:18:57.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:56 smithi172 bash[24902]: cluster 2023-12-07T17:18:55.815280+0000 mgr.smithi172.nqsqxd (mgr.14199) 490 : cluster 0 pgmap v427: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:59.011 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:58 smithi172 bash[24902]: cluster 2023-12-07T17:18:57.816020+0000 mgr.smithi172.nqsqxd (mgr.14199) 491 : cluster 0 pgmap v428: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:18:59.193 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:18:59.193 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:18:59.970 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:00.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:18:59 smithi172 bash[24902]: audit 2023-12-07T17:18:59.184220+0000 mgr.smithi172.nqsqxd (mgr.14199) 492 : audit 0 from='client.14608 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:00.971 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:01.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:00 smithi172 bash[24902]: cluster 2023-12-07T17:18:59.816808+0000 mgr.smithi172.nqsqxd (mgr.14199) 493 : cluster 0 pgmap v429: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:02.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:02 smithi172 bash[24902]: cluster 2023-12-07T17:19:01.817671+0000 mgr.smithi172.nqsqxd (mgr.14199) 494 : cluster 0 pgmap v430: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:05.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:04 smithi172 bash[24902]: cluster 2023-12-07T17:19:03.818333+0000 mgr.smithi172.nqsqxd (mgr.14199) 495 : cluster 0 pgmap v431: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:05.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:04 smithi172 bash[24902]: audit 2023-12-07T17:19:04.092665+0000 mon.smithi172 (mon.0) 583 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:19:05.766 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:07.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:06 smithi172 bash[24902]: cluster 2023-12-07T17:19:05.819005+0000 mgr.smithi172.nqsqxd (mgr.14199) 496 : cluster 0 pgmap v432: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:09.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:08 smithi172 bash[24902]: cluster 2023-12-07T17:19:07.819771+0000 mgr.smithi172.nqsqxd (mgr.14199) 497 : cluster 0 pgmap v433: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:09.176 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:09.176 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:19:10.032 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:10.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:09 smithi172 bash[24902]: audit 2023-12-07T17:19:09.164675+0000 mgr.smithi172.nqsqxd (mgr.14199) 498 : audit 0 from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:11.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:11.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:10 smithi172 bash[24902]: cluster 2023-12-07T17:19:09.820445+0000 mgr.smithi172.nqsqxd (mgr.14199) 499 : cluster 0 pgmap v434: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:12.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:12 smithi172 bash[24902]: cluster 2023-12-07T17:19:11.821282+0000 mgr.smithi172.nqsqxd (mgr.14199) 500 : cluster 0 pgmap v435: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:15.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:14 smithi172 bash[24902]: cluster 2023-12-07T17:19:13.821855+0000 mgr.smithi172.nqsqxd (mgr.14199) 501 : cluster 0 pgmap v436: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:15.829 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:17.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:16 smithi172 bash[24902]: cluster 2023-12-07T17:19:15.822551+0000 mgr.smithi172.nqsqxd (mgr.14199) 502 : cluster 0 pgmap v437: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:18.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:17 smithi172 bash[24902]: audit 2023-12-07T17:19:17.840055+0000 mon.smithi172 (mon.0) 584 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:19:19.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:18 smithi172 bash[24902]: cluster 2023-12-07T17:19:17.823338+0000 mgr.smithi172.nqsqxd (mgr.14199) 503 : cluster 0 pgmap v438: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:19.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:18 smithi172 bash[24902]: audit 2023-12-07T17:19:18.413642+0000 mon.smithi172 (mon.0) 585 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:19:19.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:18 smithi172 bash[24902]: audit 2023-12-07T17:19:18.415173+0000 mon.smithi172 (mon.0) 586 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:19:19.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:18 smithi172 bash[24902]: audit 2023-12-07T17:19:18.423255+0000 mon.smithi172 (mon.0) 587 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:19:19.215 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:19.215 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:19:20.036 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:20.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:19 smithi172 bash[24902]: cluster 2023-12-07T17:19:18.417116+0000 mgr.smithi172.nqsqxd (mgr.14199) 504 : cluster 0 pgmap v439: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:19 smithi172 bash[24902]: cluster 2023-12-07T17:19:18.417542+0000 mgr.smithi172.nqsqxd (mgr.14199) 505 : cluster 0 pgmap v440: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:19 smithi172 bash[24902]: audit 2023-12-07T17:19:19.092849+0000 mon.smithi172 (mon.0) 588 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:19:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:19 smithi172 bash[24902]: audit 2023-12-07T17:19:19.203542+0000 mgr.smithi172.nqsqxd (mgr.14199) 506 : audit 0 from='client.14612 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:21.037 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:22.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:21 smithi172 bash[24902]: cluster 2023-12-07T17:19:20.418193+0000 mgr.smithi172.nqsqxd (mgr.14199) 507 : cluster 0 pgmap v441: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:24.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:23 smithi172 bash[24902]: cluster 2023-12-07T17:19:22.418839+0000 mgr.smithi172.nqsqxd (mgr.14199) 508 : cluster 0 pgmap v442: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:25.843 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:26.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:25 smithi172 bash[24902]: cluster 2023-12-07T17:19:24.419307+0000 mgr.smithi172.nqsqxd (mgr.14199) 509 : cluster 0 pgmap v443: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:28.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:27 smithi172 bash[24902]: cluster 2023-12-07T17:19:26.419771+0000 mgr.smithi172.nqsqxd (mgr.14199) 510 : cluster 0 pgmap v444: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:29.158 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:29.159 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:19:29.949 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:30.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:29 smithi172 bash[24902]: cluster 2023-12-07T17:19:28.420191+0000 mgr.smithi172.nqsqxd (mgr.14199) 511 : cluster 0 pgmap v445: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:30.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:29 smithi172 bash[24902]: audit 2023-12-07T17:19:29.147385+0000 mgr.smithi172.nqsqxd (mgr.14199) 512 : audit 0 from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:30.951 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:32.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:31 smithi172 bash[24902]: cluster 2023-12-07T17:19:30.420759+0000 mgr.smithi172.nqsqxd (mgr.14199) 513 : cluster 0 pgmap v446: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:34.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:33 smithi172 bash[24902]: cluster 2023-12-07T17:19:32.421548+0000 mgr.smithi172.nqsqxd (mgr.14199) 514 : cluster 0 pgmap v447: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:35.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:34 smithi172 bash[24902]: audit 2023-12-07T17:19:34.093316+0000 mon.smithi172 (mon.0) 589 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:19:35.745 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:36.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:35 smithi172 bash[24902]: cluster 2023-12-07T17:19:34.422213+0000 mgr.smithi172.nqsqxd (mgr.14199) 515 : cluster 0 pgmap v448: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:38.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:37 smithi172 bash[24902]: cluster 2023-12-07T17:19:36.423086+0000 mgr.smithi172.nqsqxd (mgr.14199) 516 : cluster 0 pgmap v449: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:39.150 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:39.151 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:19:39.913 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:40.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:39 smithi172 bash[24902]: cluster 2023-12-07T17:19:38.423709+0000 mgr.smithi172.nqsqxd (mgr.14199) 517 : cluster 0 pgmap v450: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:40.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:39 smithi172 bash[24902]: audit 2023-12-07T17:19:39.141354+0000 mgr.smithi172.nqsqxd (mgr.14199) 518 : audit 0 from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:40.914 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:42.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:41 smithi172 bash[24902]: cluster 2023-12-07T17:19:40.424343+0000 mgr.smithi172.nqsqxd (mgr.14199) 519 : cluster 0 pgmap v451: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:44.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:43 smithi172 bash[24902]: cluster 2023-12-07T17:19:42.425180+0000 mgr.smithi172.nqsqxd (mgr.14199) 520 : cluster 0 pgmap v452: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:45.709 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:46.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:45 smithi172 bash[24902]: cluster 2023-12-07T17:19:44.425960+0000 mgr.smithi172.nqsqxd (mgr.14199) 521 : cluster 0 pgmap v453: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:48.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:47 smithi172 bash[24902]: cluster 2023-12-07T17:19:46.426984+0000 mgr.smithi172.nqsqxd (mgr.14199) 522 : cluster 0 pgmap v454: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:49.169 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:49.170 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:19:49.982 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:19:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:49 smithi172 bash[24902]: cluster 2023-12-07T17:19:48.427710+0000 mgr.smithi172.nqsqxd (mgr.14199) 523 : cluster 0 pgmap v455: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:50.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:49 smithi172 bash[24902]: audit 2023-12-07T17:19:49.092998+0000 mon.smithi172 (mon.0) 590 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:19:50.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:49 smithi172 bash[24902]: audit 2023-12-07T17:19:49.164604+0000 mgr.smithi172.nqsqxd (mgr.14199) 524 : audit 0 from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:19:50.983 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:19:52.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:51 smithi172 bash[24902]: cluster 2023-12-07T17:19:50.428327+0000 mgr.smithi172.nqsqxd (mgr.14199) 525 : cluster 0 pgmap v456: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:54.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:53 smithi172 bash[24902]: cluster 2023-12-07T17:19:52.429155+0000 mgr.smithi172.nqsqxd (mgr.14199) 526 : cluster 0 pgmap v457: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:55.773 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:19:56.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:55 smithi172 bash[24902]: cluster 2023-12-07T17:19:54.429843+0000 mgr.smithi172.nqsqxd (mgr.14199) 527 : cluster 0 pgmap v458: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:58.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:57 smithi172 bash[24902]: cluster 2023-12-07T17:19:56.430354+0000 mgr.smithi172.nqsqxd (mgr.14199) 528 : cluster 0 pgmap v459: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:19:59.247 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:19:59.247 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:00.034 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:00.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:59 smithi172 bash[24902]: cluster 2023-12-07T17:19:58.430972+0000 mgr.smithi172.nqsqxd (mgr.14199) 529 : cluster 0 pgmap v460: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:00.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:19:59 smithi172 bash[24902]: audit 2023-12-07T17:19:59.237647+0000 mgr.smithi172.nqsqxd (mgr.14199) 530 : audit 0 from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:01.035 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:02.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:01 smithi172 bash[24902]: cluster 2023-12-07T17:20:00.431626+0000 mgr.smithi172.nqsqxd (mgr.14199) 531 : cluster 0 pgmap v461: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:04.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:03 smithi172 bash[24902]: cluster 2023-12-07T17:20:02.432483+0000 mgr.smithi172.nqsqxd (mgr.14199) 532 : cluster 0 pgmap v462: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:05.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:04 smithi172 bash[24902]: audit 2023-12-07T17:20:04.094024+0000 mon.smithi172 (mon.0) 591 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:20:05.828 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:06.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:05 smithi172 bash[24902]: cluster 2023-12-07T17:20:04.433164+0000 mgr.smithi172.nqsqxd (mgr.14199) 533 : cluster 0 pgmap v463: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:08.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:07 smithi172 bash[24902]: cluster 2023-12-07T17:20:06.433976+0000 mgr.smithi172.nqsqxd (mgr.14199) 534 : cluster 0 pgmap v464: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:09.224 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:09.224 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:09.993 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:10.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:09 smithi172 bash[24902]: cluster 2023-12-07T17:20:08.434728+0000 mgr.smithi172.nqsqxd (mgr.14199) 535 : cluster 0 pgmap v465: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:10.313 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:09 smithi172 bash[24902]: audit 2023-12-07T17:20:09.213457+0000 mgr.smithi172.nqsqxd (mgr.14199) 536 : audit 0 from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:10.995 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:12.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:11 smithi172 bash[24902]: cluster 2023-12-07T17:20:10.435471+0000 mgr.smithi172.nqsqxd (mgr.14199) 537 : cluster 0 pgmap v466: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:14.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:13 smithi172 bash[24902]: cluster 2023-12-07T17:20:12.436388+0000 mgr.smithi172.nqsqxd (mgr.14199) 538 : cluster 0 pgmap v467: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:15.792 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:16.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:15 smithi172 bash[24902]: cluster 2023-12-07T17:20:14.437043+0000 mgr.smithi172.nqsqxd (mgr.14199) 539 : cluster 0 pgmap v468: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:18.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:17 smithi172 bash[24902]: cluster 2023-12-07T17:20:16.437955+0000 mgr.smithi172.nqsqxd (mgr.14199) 540 : cluster 0 pgmap v469: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:19.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:18 smithi172 bash[24902]: audit 2023-12-07T17:20:18.474094+0000 mon.smithi172 (mon.0) 592 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:20:19.215 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:19.215 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:20.075 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: cluster 2023-12-07T17:20:18.438765+0000 mgr.smithi172.nqsqxd (mgr.14199) 541 : cluster 0 pgmap v470: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.094068+0000 mon.smithi172 (mon.0) 593 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.094805+0000 mon.smithi172 (mon.0) 594 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.097566+0000 mon.smithi172 (mon.0) 595 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.104651+0000 mon.smithi172 (mon.0) 596 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.111391+0000 mon.smithi172 (mon.0) 597 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: cephadm 2023-12-07T17:20:19.113943+0000 mgr.smithi172.nqsqxd (mgr.14199) 542 : cephadm 1 Adjusting osd_memory_target on smithi172 to 956.4M 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.117057+0000 mon.smithi172 (mon.0) 598 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:20:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.119356+0000 mon.smithi172 (mon.0) 599 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:20:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.120402+0000 mon.smithi172 (mon.0) 600 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:20:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: cluster 2023-12-07T17:20:19.122256+0000 mgr.smithi172.nqsqxd (mgr.14199) 543 : cluster 0 pgmap v471: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: cluster 2023-12-07T17:20:19.122544+0000 mgr.smithi172.nqsqxd (mgr.14199) 544 : cluster 0 pgmap v472: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.127269+0000 mon.smithi172 (mon.0) 601 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:20:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:19 smithi172 bash[24902]: audit 2023-12-07T17:20:19.209402+0000 mgr.smithi172.nqsqxd (mgr.14199) 545 : audit 0 from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:21.091 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:22.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:22 smithi172 bash[24902]: cluster 2023-12-07T17:20:21.123286+0000 mgr.smithi172.nqsqxd (mgr.14199) 546 : cluster 0 pgmap v473: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:24 smithi172 bash[24902]: cluster 2023-12-07T17:20:23.124176+0000 mgr.smithi172.nqsqxd (mgr.14199) 547 : cluster 0 pgmap v474: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:25.887 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:26.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:26 smithi172 bash[24902]: cluster 2023-12-07T17:20:25.124783+0000 mgr.smithi172.nqsqxd (mgr.14199) 548 : cluster 0 pgmap v475: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:27.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:27 smithi172 bash[24902]: cluster 2023-12-07T17:20:27.125269+0000 mgr.smithi172.nqsqxd (mgr.14199) 549 : cluster 0 pgmap v476: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:29.358 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:29.358 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:30.420 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:30.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:30 smithi172 bash[24902]: cluster 2023-12-07T17:20:29.125841+0000 mgr.smithi172.nqsqxd (mgr.14199) 550 : cluster 0 pgmap v477: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:31.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:31.435 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:31 smithi172 bash[24902]: audit 2023-12-07T17:20:29.348510+0000 mgr.smithi172.nqsqxd (mgr.14199) 551 : audit 0 from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:32.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:32 smithi172 bash[24902]: cluster 2023-12-07T17:20:31.126570+0000 mgr.smithi172.nqsqxd (mgr.14199) 552 : cluster 0 pgmap v478: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:34 smithi172 bash[24902]: cluster 2023-12-07T17:20:33.127253+0000 mgr.smithi172.nqsqxd (mgr.14199) 553 : cluster 0 pgmap v479: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:34 smithi172 bash[24902]: audit 2023-12-07T17:20:34.094846+0000 mon.smithi172 (mon.0) 602 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:20:36.216 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:36.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:36 smithi172 bash[24902]: cluster 2023-12-07T17:20:35.127895+0000 mgr.smithi172.nqsqxd (mgr.14199) 554 : cluster 0 pgmap v480: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:37.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:37 smithi172 bash[24902]: cluster 2023-12-07T17:20:37.128817+0000 mgr.smithi172.nqsqxd (mgr.14199) 555 : cluster 0 pgmap v481: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:39.431 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:39.431 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:40.233 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:40.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:40 smithi172 bash[24902]: cluster 2023-12-07T17:20:39.129305+0000 mgr.smithi172.nqsqxd (mgr.14199) 556 : cluster 0 pgmap v482: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:41.234 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:41.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:41 smithi172 bash[24902]: audit 2023-12-07T17:20:39.422035+0000 mgr.smithi172.nqsqxd (mgr.14199) 557 : audit 0 from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:42.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:42 smithi172 bash[24902]: cluster 2023-12-07T17:20:41.129994+0000 mgr.smithi172.nqsqxd (mgr.14199) 558 : cluster 0 pgmap v483: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:44.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:44 smithi172 bash[24902]: cluster 2023-12-07T17:20:43.130914+0000 mgr.smithi172.nqsqxd (mgr.14199) 559 : cluster 0 pgmap v484: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:46.028 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:46.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:46 smithi172 bash[24902]: cluster 2023-12-07T17:20:45.131637+0000 mgr.smithi172.nqsqxd (mgr.14199) 560 : cluster 0 pgmap v485: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:47.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:47 smithi172 bash[24902]: cluster 2023-12-07T17:20:47.132467+0000 mgr.smithi172.nqsqxd (mgr.14199) 561 : cluster 0 pgmap v486: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:49.362 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:49.363 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:20:49.421 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:49 smithi172 bash[24902]: audit 2023-12-07T17:20:49.095171+0000 mon.smithi172 (mon.0) 603 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:20:50.133 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:20:50.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:50 smithi172 bash[24902]: cluster 2023-12-07T17:20:49.133019+0000 mgr.smithi172.nqsqxd (mgr.14199) 562 : cluster 0 pgmap v487: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:51.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:20:51.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:51 smithi172 bash[24902]: audit 2023-12-07T17:20:49.353341+0000 mgr.smithi172.nqsqxd (mgr.14199) 563 : audit 0 from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:20:52.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:52 smithi172 bash[24902]: cluster 2023-12-07T17:20:51.133844+0000 mgr.smithi172.nqsqxd (mgr.14199) 564 : cluster 0 pgmap v488: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:54.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:54 smithi172 bash[24902]: cluster 2023-12-07T17:20:53.134788+0000 mgr.smithi172.nqsqxd (mgr.14199) 565 : cluster 0 pgmap v489: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:55.925 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:20:56.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:56 smithi172 bash[24902]: cluster 2023-12-07T17:20:55.135428+0000 mgr.smithi172.nqsqxd (mgr.14199) 566 : cluster 0 pgmap v490: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:57.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:20:57 smithi172 bash[24902]: cluster 2023-12-07T17:20:57.136294+0000 mgr.smithi172.nqsqxd (mgr.14199) 567 : cluster 0 pgmap v491: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:20:59.447 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:20:59.447 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:00.212 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:00.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:00 smithi172 bash[24902]: cluster 2023-12-07T17:20:59.136973+0000 mgr.smithi172.nqsqxd (mgr.14199) 568 : cluster 0 pgmap v492: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:01.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:01.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:01 smithi172 bash[24902]: audit 2023-12-07T17:20:59.437696+0000 mgr.smithi172.nqsqxd (mgr.14199) 569 : audit 0 from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:02.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:02 smithi172 bash[24902]: cluster 2023-12-07T17:21:01.137704+0000 mgr.smithi172.nqsqxd (mgr.14199) 570 : cluster 0 pgmap v493: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:04.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:04 smithi172 bash[24902]: cluster 2023-12-07T17:21:03.138501+0000 mgr.smithi172.nqsqxd (mgr.14199) 571 : cluster 0 pgmap v494: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:04.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:04 smithi172 bash[24902]: audit 2023-12-07T17:21:04.095749+0000 mon.smithi172 (mon.0) 604 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:21:06.021 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:06.357 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:06 smithi172 bash[24902]: cluster 2023-12-07T17:21:05.139168+0000 mgr.smithi172.nqsqxd (mgr.14199) 572 : cluster 0 pgmap v495: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:07.875 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:07 smithi172 bash[24902]: cluster 2023-12-07T17:21:07.139884+0000 mgr.smithi172.nqsqxd (mgr.14199) 573 : cluster 0 pgmap v496: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:09.516 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:09.516 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:10.316 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:10.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:10 smithi172 bash[24902]: cluster 2023-12-07T17:21:09.140429+0000 mgr.smithi172.nqsqxd (mgr.14199) 574 : cluster 0 pgmap v497: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:11.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:11.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:11 smithi172 bash[24902]: audit 2023-12-07T17:21:09.506244+0000 mgr.smithi172.nqsqxd (mgr.14199) 575 : audit 0 from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:12.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:12 smithi172 bash[24902]: cluster 2023-12-07T17:21:11.141160+0000 mgr.smithi172.nqsqxd (mgr.14199) 576 : cluster 0 pgmap v498: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:14.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:14 smithi172 bash[24902]: cluster 2023-12-07T17:21:13.141920+0000 mgr.smithi172.nqsqxd (mgr.14199) 577 : cluster 0 pgmap v499: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:16.106 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:16.519 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:16 smithi172 bash[24902]: cluster 2023-12-07T17:21:15.142618+0000 mgr.smithi172.nqsqxd (mgr.14199) 578 : cluster 0 pgmap v500: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:17 smithi172 bash[24902]: cluster 2023-12-07T17:21:17.143655+0000 mgr.smithi172.nqsqxd (mgr.14199) 579 : cluster 0 pgmap v501: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:19.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:19 smithi172 bash[24902]: audit 2023-12-07T17:21:19.095273+0000 mon.smithi172 (mon.0) 605 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:21:19.593 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:19.594 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:20.359 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:20.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:20 smithi172 bash[24902]: cluster 2023-12-07T17:21:19.144248+0000 mgr.smithi172.nqsqxd (mgr.14199) 580 : cluster 0 pgmap v502: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:20.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:20 smithi172 bash[24902]: audit 2023-12-07T17:21:19.178551+0000 mon.smithi172 (mon.0) 606 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:21:20.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:20 smithi172 bash[24902]: audit 2023-12-07T17:21:19.804087+0000 mon.smithi172 (mon.0) 607 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:21:20.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:20 smithi172 bash[24902]: audit 2023-12-07T17:21:19.805291+0000 mon.smithi172 (mon.0) 608 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:21:20.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:20 smithi172 bash[24902]: audit 2023-12-07T17:21:19.814157+0000 mon.smithi172 (mon.0) 609 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:21:21.359 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:21.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:21 smithi172 bash[24902]: audit 2023-12-07T17:21:19.587103+0000 mgr.smithi172.nqsqxd (mgr.14199) 581 : audit 0 from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:21.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:21 smithi172 bash[24902]: cluster 2023-12-07T17:21:19.807329+0000 mgr.smithi172.nqsqxd (mgr.14199) 582 : cluster 0 pgmap v503: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:21.597 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:21 smithi172 bash[24902]: cluster 2023-12-07T17:21:19.807828+0000 mgr.smithi172.nqsqxd (mgr.14199) 583 : cluster 0 pgmap v504: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:23.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:22 smithi172 bash[24902]: cluster 2023-12-07T17:21:21.808634+0000 mgr.smithi172.nqsqxd (mgr.14199) 584 : cluster 0 pgmap v505: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:25.125 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:24 smithi172 bash[24902]: cluster 2023-12-07T17:21:23.809358+0000 mgr.smithi172.nqsqxd (mgr.14199) 585 : cluster 0 pgmap v506: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:26.164 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:27.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:26 smithi172 bash[24902]: cluster 2023-12-07T17:21:25.810002+0000 mgr.smithi172.nqsqxd (mgr.14199) 586 : cluster 0 pgmap v507: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:29.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:28 smithi172 bash[24902]: cluster 2023-12-07T17:21:27.810829+0000 mgr.smithi172.nqsqxd (mgr.14199) 587 : cluster 0 pgmap v508: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:29.507 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:29.507 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:30.339 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:31.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:30 smithi172 bash[24902]: audit 2023-12-07T17:21:29.497334+0000 mgr.smithi172.nqsqxd (mgr.14199) 588 : audit 0 from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:31.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:30 smithi172 bash[24902]: cluster 2023-12-07T17:21:29.811445+0000 mgr.smithi172.nqsqxd (mgr.14199) 589 : cluster 0 pgmap v509: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:31.340 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:33.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:32 smithi172 bash[24902]: cluster 2023-12-07T17:21:31.811996+0000 mgr.smithi172.nqsqxd (mgr.14199) 590 : cluster 0 pgmap v510: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:35.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:34 smithi172 bash[24902]: cluster 2023-12-07T17:21:33.812733+0000 mgr.smithi172.nqsqxd (mgr.14199) 591 : cluster 0 pgmap v511: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:35.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:34 smithi172 bash[24902]: audit 2023-12-07T17:21:34.096235+0000 mon.smithi172 (mon.0) 610 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:21:36.130 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:37.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:36 smithi172 bash[24902]: cluster 2023-12-07T17:21:35.813463+0000 mgr.smithi172.nqsqxd (mgr.14199) 592 : cluster 0 pgmap v512: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:39.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:38 smithi172 bash[24902]: cluster 2023-12-07T17:21:37.814207+0000 mgr.smithi172.nqsqxd (mgr.14199) 593 : cluster 0 pgmap v513: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:39.398 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:39.398 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:40.161 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:41.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:40 smithi172 bash[24902]: audit 2023-12-07T17:21:39.387293+0000 mgr.smithi172.nqsqxd (mgr.14199) 594 : audit 0 from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:41.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:40 smithi172 bash[24902]: cluster 2023-12-07T17:21:39.814905+0000 mgr.smithi172.nqsqxd (mgr.14199) 595 : cluster 0 pgmap v514: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:41.163 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:43.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:42 smithi172 bash[24902]: cluster 2023-12-07T17:21:41.815855+0000 mgr.smithi172.nqsqxd (mgr.14199) 596 : cluster 0 pgmap v515: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:45.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:44 smithi172 bash[24902]: cluster 2023-12-07T17:21:43.816532+0000 mgr.smithi172.nqsqxd (mgr.14199) 597 : cluster 0 pgmap v516: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:45.949 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:47.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:46 smithi172 bash[24902]: cluster 2023-12-07T17:21:45.817241+0000 mgr.smithi172.nqsqxd (mgr.14199) 598 : cluster 0 pgmap v517: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:49.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:48 smithi172 bash[24902]: cluster 2023-12-07T17:21:47.818205+0000 mgr.smithi172.nqsqxd (mgr.14199) 599 : cluster 0 pgmap v518: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:49.199 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:49.199 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:50.066 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:21:50.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:49 smithi172 bash[24902]: audit 2023-12-07T17:21:49.096459+0000 mon.smithi172 (mon.0) 611 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:21:50.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:49 smithi172 bash[24902]: audit 2023-12-07T17:21:49.190744+0000 mgr.smithi172.nqsqxd (mgr.14199) 600 : audit 0 from='client.14642 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:21:51.068 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:21:51.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:50 smithi172 bash[24902]: cluster 2023-12-07T17:21:49.818800+0000 mgr.smithi172.nqsqxd (mgr.14199) 601 : cluster 0 pgmap v519: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:53.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:52 smithi172 bash[24902]: cluster 2023-12-07T17:21:51.819546+0000 mgr.smithi172.nqsqxd (mgr.14199) 602 : cluster 0 pgmap v520: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:55.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:54 smithi172 bash[24902]: cluster 2023-12-07T17:21:53.820098+0000 mgr.smithi172.nqsqxd (mgr.14199) 603 : cluster 0 pgmap v521: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:55.861 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:21:57.146 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:56 smithi172 bash[24902]: cluster 2023-12-07T17:21:55.820818+0000 mgr.smithi172.nqsqxd (mgr.14199) 604 : cluster 0 pgmap v522: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:59.002 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:21:59.002 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:21:59.228 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:58 smithi172 bash[24902]: cluster 2023-12-07T17:21:57.821799+0000 mgr.smithi172.nqsqxd (mgr.14199) 605 : cluster 0 pgmap v523: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:21:59.765 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:00.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:21:59 smithi172 bash[24902]: audit 2023-12-07T17:21:58.990815+0000 mgr.smithi172.nqsqxd (mgr.14199) 606 : audit 0 from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:00.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:01.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:00 smithi172 bash[24902]: cluster 2023-12-07T17:21:59.822630+0000 mgr.smithi172.nqsqxd (mgr.14199) 607 : cluster 0 pgmap v524: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:03.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:02 smithi172 bash[24902]: cluster 2023-12-07T17:22:01.823559+0000 mgr.smithi172.nqsqxd (mgr.14199) 608 : cluster 0 pgmap v525: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:04 smithi172 bash[24902]: cluster 2023-12-07T17:22:03.824335+0000 mgr.smithi172.nqsqxd (mgr.14199) 609 : cluster 0 pgmap v526: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:04 smithi172 bash[24902]: audit 2023-12-07T17:22:04.097066+0000 mon.smithi172 (mon.0) 612 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:22:05.558 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:07.275 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:06 smithi172 bash[24902]: cluster 2023-12-07T17:22:05.825095+0000 mgr.smithi172.nqsqxd (mgr.14199) 610 : cluster 0 pgmap v527: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:08.787 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:08.787 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:09.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:08 smithi172 bash[24902]: cluster 2023-12-07T17:22:07.825873+0000 mgr.smithi172.nqsqxd (mgr.14199) 611 : cluster 0 pgmap v528: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:09.601 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:10.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:09 smithi172 bash[24902]: audit 2023-12-07T17:22:08.777572+0000 mgr.smithi172.nqsqxd (mgr.14199) 612 : audit 0 from='client.14646 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:10.602 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:11.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:10 smithi172 bash[24902]: cluster 2023-12-07T17:22:09.826577+0000 mgr.smithi172.nqsqxd (mgr.14199) 613 : cluster 0 pgmap v529: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:12.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:12 smithi172 bash[24902]: cluster 2023-12-07T17:22:11.827190+0000 mgr.smithi172.nqsqxd (mgr.14199) 614 : cluster 0 pgmap v530: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:15.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:14 smithi172 bash[24902]: cluster 2023-12-07T17:22:13.827831+0000 mgr.smithi172.nqsqxd (mgr.14199) 615 : cluster 0 pgmap v531: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:15.391 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:17.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:16 smithi172 bash[24902]: cluster 2023-12-07T17:22:15.828546+0000 mgr.smithi172.nqsqxd (mgr.14199) 616 : cluster 0 pgmap v532: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:18.789 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:18.789 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:19.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:18 smithi172 bash[24902]: cluster 2023-12-07T17:22:17.829419+0000 mgr.smithi172.nqsqxd (mgr.14199) 617 : cluster 0 pgmap v533: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:19.610 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:19 smithi172 bash[24902]: audit 2023-12-07T17:22:18.779764+0000 mgr.smithi172.nqsqxd (mgr.14199) 618 : audit 0 from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:19 smithi172 bash[24902]: audit 2023-12-07T17:22:19.097321+0000 mon.smithi172 (mon.0) 613 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:22:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:19 smithi172 bash[24902]: audit 2023-12-07T17:22:19.857745+0000 mon.smithi172 (mon.0) 614 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:22:20.611 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:20 smithi172 bash[24902]: cluster 2023-12-07T17:22:19.830088+0000 mgr.smithi172.nqsqxd (mgr.14199) 619 : cluster 0 pgmap v534: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:20 smithi172 bash[24902]: audit 2023-12-07T17:22:20.481743+0000 mon.smithi172 (mon.0) 615 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:22:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:20 smithi172 bash[24902]: audit 2023-12-07T17:22:20.483534+0000 mon.smithi172 (mon.0) 616 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:22:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:20 smithi172 bash[24902]: audit 2023-12-07T17:22:20.491601+0000 mon.smithi172 (mon.0) 617 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:22:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:21 smithi172 bash[24902]: cluster 2023-12-07T17:22:20.486284+0000 mgr.smithi172.nqsqxd (mgr.14199) 620 : cluster 0 pgmap v535: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:21 smithi172 bash[24902]: cluster 2023-12-07T17:22:20.486644+0000 mgr.smithi172.nqsqxd (mgr.14199) 621 : cluster 0 pgmap v536: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:24.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:23 smithi172 bash[24902]: cluster 2023-12-07T17:22:22.487380+0000 mgr.smithi172.nqsqxd (mgr.14199) 622 : cluster 0 pgmap v537: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:25.400 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:26.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:25 smithi172 bash[24902]: cluster 2023-12-07T17:22:24.488060+0000 mgr.smithi172.nqsqxd (mgr.14199) 623 : cluster 0 pgmap v538: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:28.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:27 smithi172 bash[24902]: cluster 2023-12-07T17:22:26.488848+0000 mgr.smithi172.nqsqxd (mgr.14199) 624 : cluster 0 pgmap v539: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:28.914 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:28.914 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:29.737 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:30.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:29 smithi172 bash[24902]: cluster 2023-12-07T17:22:28.489524+0000 mgr.smithi172.nqsqxd (mgr.14199) 625 : cluster 0 pgmap v540: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:30.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:29 smithi172 bash[24902]: audit 2023-12-07T17:22:28.904917+0000 mgr.smithi172.nqsqxd (mgr.14199) 626 : audit 0 from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:30.738 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:32.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:31 smithi172 bash[24902]: cluster 2023-12-07T17:22:30.490202+0000 mgr.smithi172.nqsqxd (mgr.14199) 627 : cluster 0 pgmap v541: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:34.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:33 smithi172 bash[24902]: cluster 2023-12-07T17:22:32.491049+0000 mgr.smithi172.nqsqxd (mgr.14199) 628 : cluster 0 pgmap v542: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:35.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:34 smithi172 bash[24902]: audit 2023-12-07T17:22:34.097647+0000 mon.smithi172 (mon.0) 618 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:22:35.538 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:36.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:35 smithi172 bash[24902]: cluster 2023-12-07T17:22:34.491697+0000 mgr.smithi172.nqsqxd (mgr.14199) 629 : cluster 0 pgmap v543: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:38.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:37 smithi172 bash[24902]: cluster 2023-12-07T17:22:36.492622+0000 mgr.smithi172.nqsqxd (mgr.14199) 630 : cluster 0 pgmap v544: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:38.873 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:38.874 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:39.701 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:40.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:39 smithi172 bash[24902]: cluster 2023-12-07T17:22:38.493269+0000 mgr.smithi172.nqsqxd (mgr.14199) 631 : cluster 0 pgmap v545: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:40.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:39 smithi172 bash[24902]: audit 2023-12-07T17:22:38.864250+0000 mgr.smithi172.nqsqxd (mgr.14199) 632 : audit 0 from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:40.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:42.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:41 smithi172 bash[24902]: cluster 2023-12-07T17:22:40.493938+0000 mgr.smithi172.nqsqxd (mgr.14199) 633 : cluster 0 pgmap v546: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:44.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:43 smithi172 bash[24902]: cluster 2023-12-07T17:22:42.494738+0000 mgr.smithi172.nqsqxd (mgr.14199) 634 : cluster 0 pgmap v547: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:45.498 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:46.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:45 smithi172 bash[24902]: cluster 2023-12-07T17:22:44.495314+0000 mgr.smithi172.nqsqxd (mgr.14199) 635 : cluster 0 pgmap v548: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:48.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:47 smithi172 bash[24902]: cluster 2023-12-07T17:22:46.496172+0000 mgr.smithi172.nqsqxd (mgr.14199) 636 : cluster 0 pgmap v549: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:48.920 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:48.921 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:49.692 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:22:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:49 smithi172 bash[24902]: cluster 2023-12-07T17:22:48.496872+0000 mgr.smithi172.nqsqxd (mgr.14199) 637 : cluster 0 pgmap v550: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:49 smithi172 bash[24902]: audit 2023-12-07T17:22:48.911244+0000 mgr.smithi172.nqsqxd (mgr.14199) 638 : audit 0 from='client.14654 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:22:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:49 smithi172 bash[24902]: audit 2023-12-07T17:22:49.098366+0000 mon.smithi172 (mon.0) 619 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:22:50.693 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:22:52.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:51 smithi172 bash[24902]: cluster 2023-12-07T17:22:50.497523+0000 mgr.smithi172.nqsqxd (mgr.14199) 639 : cluster 0 pgmap v551: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:54.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:53 smithi172 bash[24902]: cluster 2023-12-07T17:22:52.498376+0000 mgr.smithi172.nqsqxd (mgr.14199) 640 : cluster 0 pgmap v552: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:55.488 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:22:56.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:55 smithi172 bash[24902]: cluster 2023-12-07T17:22:54.499086+0000 mgr.smithi172.nqsqxd (mgr.14199) 641 : cluster 0 pgmap v553: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:58.280 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:57 smithi172 bash[24902]: cluster 2023-12-07T17:22:56.499798+0000 mgr.smithi172.nqsqxd (mgr.14199) 642 : cluster 0 pgmap v554: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:22:58.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:22:58.742 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:22:59.565 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:00.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:59 smithi172 bash[24902]: cluster 2023-12-07T17:22:58.500401+0000 mgr.smithi172.nqsqxd (mgr.14199) 643 : cluster 0 pgmap v555: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:00.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:22:59 smithi172 bash[24902]: audit 2023-12-07T17:22:58.732210+0000 mgr.smithi172.nqsqxd (mgr.14199) 644 : audit 0 from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:00.567 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:02.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:01 smithi172 bash[24902]: cluster 2023-12-07T17:23:00.501071+0000 mgr.smithi172.nqsqxd (mgr.14199) 645 : cluster 0 pgmap v556: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:04.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:03 smithi172 bash[24902]: cluster 2023-12-07T17:23:02.501904+0000 mgr.smithi172.nqsqxd (mgr.14199) 646 : cluster 0 pgmap v557: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:05.358 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:04 smithi172 bash[24902]: audit 2023-12-07T17:23:04.098662+0000 mon.smithi172 (mon.0) 620 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:23:06.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:05 smithi172 bash[24902]: cluster 2023-12-07T17:23:04.502595+0000 mgr.smithi172.nqsqxd (mgr.14199) 647 : cluster 0 pgmap v558: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:08.320 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:07 smithi172 bash[24902]: cluster 2023-12-07T17:23:06.503238+0000 mgr.smithi172.nqsqxd (mgr.14199) 648 : cluster 0 pgmap v559: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:08.799 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:08.799 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:23:09.711 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:10.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:09 smithi172 bash[24902]: cluster 2023-12-07T17:23:08.503632+0000 mgr.smithi172.nqsqxd (mgr.14199) 649 : cluster 0 pgmap v560: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:10.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:09 smithi172 bash[24902]: audit 2023-12-07T17:23:08.787177+0000 mgr.smithi172.nqsqxd (mgr.14199) 650 : audit 0 from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:10.711 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:12.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:11 smithi172 bash[24902]: cluster 2023-12-07T17:23:10.504249+0000 mgr.smithi172.nqsqxd (mgr.14199) 651 : cluster 0 pgmap v561: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:14.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:13 smithi172 bash[24902]: cluster 2023-12-07T17:23:12.505038+0000 mgr.smithi172.nqsqxd (mgr.14199) 652 : cluster 0 pgmap v562: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:15.508 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:16.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:15 smithi172 bash[24902]: cluster 2023-12-07T17:23:14.505713+0000 mgr.smithi172.nqsqxd (mgr.14199) 653 : cluster 0 pgmap v563: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:18.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:17 smithi172 bash[24902]: cluster 2023-12-07T17:23:16.506652+0000 mgr.smithi172.nqsqxd (mgr.14199) 654 : cluster 0 pgmap v564: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:19.252 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:19.253 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:23:20.049 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:19 smithi172 bash[24902]: cluster 2023-12-07T17:23:18.507384+0000 mgr.smithi172.nqsqxd (mgr.14199) 655 : cluster 0 pgmap v565: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:19 smithi172 bash[24902]: audit 2023-12-07T17:23:19.098503+0000 mon.smithi172 (mon.0) 621 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:23:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:19 smithi172 bash[24902]: audit 2023-12-07T17:23:19.242983+0000 mgr.smithi172.nqsqxd (mgr.14199) 656 : audit 0 from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:21.050 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:20 smithi172 bash[24902]: audit 2023-12-07T17:23:20.543529+0000 mon.smithi172 (mon.0) 622 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: cluster 2023-12-07T17:23:20.508088+0000 mgr.smithi172.nqsqxd (mgr.14199) 657 : cluster 0 pgmap v566: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: audit 2023-12-07T17:23:21.165838+0000 mon.smithi172 (mon.0) 623 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: audit 2023-12-07T17:23:21.167398+0000 mon.smithi172 (mon.0) 624 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: cluster 2023-12-07T17:23:21.169837+0000 mgr.smithi172.nqsqxd (mgr.14199) 658 : cluster 0 pgmap v567: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: cluster 2023-12-07T17:23:21.170328+0000 mgr.smithi172.nqsqxd (mgr.14199) 659 : cluster 0 pgmap v568: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:21 smithi172 bash[24902]: audit 2023-12-07T17:23:21.175459+0000 mon.smithi172 (mon.0) 625 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:23:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:24 smithi172 bash[24902]: cluster 2023-12-07T17:23:23.171040+0000 mgr.smithi172.nqsqxd (mgr.14199) 660 : cluster 0 pgmap v569: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:25.863 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:26.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:26 smithi172 bash[24902]: cluster 2023-12-07T17:23:25.171694+0000 mgr.smithi172.nqsqxd (mgr.14199) 661 : cluster 0 pgmap v570: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:28.071 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:27 smithi172 bash[24902]: cluster 2023-12-07T17:23:27.172511+0000 mgr.smithi172.nqsqxd (mgr.14199) 662 : cluster 0 pgmap v571: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:29.483 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:29.483 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:23:30.390 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:30.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:30 smithi172 bash[24902]: cluster 2023-12-07T17:23:29.173080+0000 mgr.smithi172.nqsqxd (mgr.14199) 663 : cluster 0 pgmap v572: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:31.391 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:31.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:31 smithi172 bash[24902]: audit 2023-12-07T17:23:29.473813+0000 mgr.smithi172.nqsqxd (mgr.14199) 664 : audit 0 from='client.14662 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:32 smithi172 bash[24902]: cluster 2023-12-07T17:23:31.173884+0000 mgr.smithi172.nqsqxd (mgr.14199) 665 : cluster 0 pgmap v573: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:34.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:34 smithi172 bash[24902]: cluster 2023-12-07T17:23:33.174793+0000 mgr.smithi172.nqsqxd (mgr.14199) 666 : cluster 0 pgmap v574: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:34.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:34 smithi172 bash[24902]: audit 2023-12-07T17:23:34.099494+0000 mon.smithi172 (mon.0) 626 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:23:36.180 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:36.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:36 smithi172 bash[24902]: cluster 2023-12-07T17:23:35.175533+0000 mgr.smithi172.nqsqxd (mgr.14199) 667 : cluster 0 pgmap v575: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:37.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:37 smithi172 bash[24902]: cluster 2023-12-07T17:23:37.176445+0000 mgr.smithi172.nqsqxd (mgr.14199) 668 : cluster 0 pgmap v576: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:39.580 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:39.580 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:23:40.350 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:40.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:40 smithi172 bash[24902]: cluster 2023-12-07T17:23:39.177041+0000 mgr.smithi172.nqsqxd (mgr.14199) 669 : cluster 0 pgmap v577: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:41.351 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:41.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:41 smithi172 bash[24902]: audit 2023-12-07T17:23:39.569186+0000 mgr.smithi172.nqsqxd (mgr.14199) 670 : audit 0 from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:42.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:42 smithi172 bash[24902]: cluster 2023-12-07T17:23:41.177745+0000 mgr.smithi172.nqsqxd (mgr.14199) 671 : cluster 0 pgmap v578: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:44.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:44 smithi172 bash[24902]: cluster 2023-12-07T17:23:43.178503+0000 mgr.smithi172.nqsqxd (mgr.14199) 672 : cluster 0 pgmap v579: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:46.147 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:46.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:46 smithi172 bash[24902]: cluster 2023-12-07T17:23:45.179096+0000 mgr.smithi172.nqsqxd (mgr.14199) 673 : cluster 0 pgmap v580: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:47.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:47 smithi172 bash[24902]: cluster 2023-12-07T17:23:47.179849+0000 mgr.smithi172.nqsqxd (mgr.14199) 674 : cluster 0 pgmap v581: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:49.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:49 smithi172 bash[24902]: audit 2023-12-07T17:23:49.099832+0000 mon.smithi172 (mon.0) 627 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:23:49.539 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:49.539 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:23:50.317 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:23:50.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:50 smithi172 bash[24902]: cluster 2023-12-07T17:23:49.180213+0000 mgr.smithi172.nqsqxd (mgr.14199) 675 : cluster 0 pgmap v582: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:51.318 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:23:51.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:51 smithi172 bash[24902]: audit 2023-12-07T17:23:49.530492+0000 mgr.smithi172.nqsqxd (mgr.14199) 676 : audit 0 from='client.14666 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:23:52.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:52 smithi172 bash[24902]: cluster 2023-12-07T17:23:51.181052+0000 mgr.smithi172.nqsqxd (mgr.14199) 677 : cluster 0 pgmap v583: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:54.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:54 smithi172 bash[24902]: cluster 2023-12-07T17:23:53.181783+0000 mgr.smithi172.nqsqxd (mgr.14199) 678 : cluster 0 pgmap v584: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:56.114 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:23:56.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:56 smithi172 bash[24902]: cluster 2023-12-07T17:23:55.182424+0000 mgr.smithi172.nqsqxd (mgr.14199) 679 : cluster 0 pgmap v585: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:57.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:23:57 smithi172 bash[24902]: cluster 2023-12-07T17:23:57.183467+0000 mgr.smithi172.nqsqxd (mgr.14199) 680 : cluster 0 pgmap v586: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:23:59.553 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:23:59.553 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:00.295 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:00.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:00 smithi172 bash[24902]: cluster 2023-12-07T17:23:59.184206+0000 mgr.smithi172.nqsqxd (mgr.14199) 681 : cluster 0 pgmap v587: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:01.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:01.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:01 smithi172 bash[24902]: audit 2023-12-07T17:23:59.543757+0000 mgr.smithi172.nqsqxd (mgr.14199) 682 : audit 0 from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:02.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:02 smithi172 bash[24902]: cluster 2023-12-07T17:24:01.184996+0000 mgr.smithi172.nqsqxd (mgr.14199) 683 : cluster 0 pgmap v588: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:04.553 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:04 smithi172 bash[24902]: cluster 2023-12-07T17:24:03.185729+0000 mgr.smithi172.nqsqxd (mgr.14199) 684 : cluster 0 pgmap v589: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:04.553 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:04 smithi172 bash[24902]: audit 2023-12-07T17:24:04.100115+0000 mon.smithi172 (mon.0) 628 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:24:06.091 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:06.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:06 smithi172 bash[24902]: cluster 2023-12-07T17:24:05.186392+0000 mgr.smithi172.nqsqxd (mgr.14199) 685 : cluster 0 pgmap v590: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:07.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:07 smithi172 bash[24902]: cluster 2023-12-07T17:24:07.187183+0000 mgr.smithi172.nqsqxd (mgr.14199) 686 : cluster 0 pgmap v591: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:09.459 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:10.255 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:10.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:10 smithi172 bash[24902]: cluster 2023-12-07T17:24:09.187822+0000 mgr.smithi172.nqsqxd (mgr.14199) 687 : cluster 0 pgmap v592: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:11.256 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:11.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:11 smithi172 bash[24902]: audit 2023-12-07T17:24:09.451922+0000 mgr.smithi172.nqsqxd (mgr.14199) 688 : audit 0 from='client.14670 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:12.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:12 smithi172 bash[24902]: cluster 2023-12-07T17:24:11.188588+0000 mgr.smithi172.nqsqxd (mgr.14199) 689 : cluster 0 pgmap v593: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:14.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:14 smithi172 bash[24902]: cluster 2023-12-07T17:24:13.189302+0000 mgr.smithi172.nqsqxd (mgr.14199) 690 : cluster 0 pgmap v594: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:16.046 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:16.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:16 smithi172 bash[24902]: cluster 2023-12-07T17:24:15.189960+0000 mgr.smithi172.nqsqxd (mgr.14199) 691 : cluster 0 pgmap v595: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:17 smithi172 bash[24902]: cluster 2023-12-07T17:24:17.190832+0000 mgr.smithi172.nqsqxd (mgr.14199) 692 : cluster 0 pgmap v596: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:19.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:19 smithi172 bash[24902]: audit 2023-12-07T17:24:19.100588+0000 mon.smithi172 (mon.0) 629 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:24:19.461 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:19.462 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:20.235 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:20.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:20 smithi172 bash[24902]: cluster 2023-12-07T17:24:19.191539+0000 mgr.smithi172.nqsqxd (mgr.14199) 693 : cluster 0 pgmap v597: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:21.236 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:21.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:21 smithi172 bash[24902]: audit 2023-12-07T17:24:19.451657+0000 mgr.smithi172.nqsqxd (mgr.14199) 694 : audit 0 from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:22 smithi172 bash[24902]: cluster 2023-12-07T17:24:21.192354+0000 mgr.smithi172.nqsqxd (mgr.14199) 695 : cluster 0 pgmap v598: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:22 smithi172 bash[24902]: audit 2023-12-07T17:24:21.226014+0000 mon.smithi172 (mon.0) 630 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:24:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:22 smithi172 bash[24902]: audit 2023-12-07T17:24:21.752426+0000 mon.smithi172 (mon.0) 631 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:24:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:22 smithi172 bash[24902]: audit 2023-12-07T17:24:21.759802+0000 mon.smithi172 (mon.0) 632 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:24:23.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:23 smithi172 bash[24902]: audit 2023-12-07T17:24:22.383229+0000 mon.smithi172 (mon.0) 633 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:24:23.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:23 smithi172 bash[24902]: audit 2023-12-07T17:24:22.385060+0000 mon.smithi172 (mon.0) 634 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:24:23.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:23 smithi172 bash[24902]: audit 2023-12-07T17:24:22.394910+0000 mon.smithi172 (mon.0) 635 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:24:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:24 smithi172 bash[24902]: cluster 2023-12-07T17:24:22.387697+0000 mgr.smithi172.nqsqxd (mgr.14199) 696 : cluster 0 pgmap v599: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:24 smithi172 bash[24902]: cluster 2023-12-07T17:24:22.388095+0000 mgr.smithi172.nqsqxd (mgr.14199) 697 : cluster 0 pgmap v600: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:26.026 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:26.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:26 smithi172 bash[24902]: cluster 2023-12-07T17:24:24.388682+0000 mgr.smithi172.nqsqxd (mgr.14199) 698 : cluster 0 pgmap v601: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:28.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:28 smithi172 bash[24902]: cluster 2023-12-07T17:24:26.389301+0000 mgr.smithi172.nqsqxd (mgr.14199) 699 : cluster 0 pgmap v602: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:29.441 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:29.442 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:30.219 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:30.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:30 smithi172 bash[24902]: cluster 2023-12-07T17:24:28.389884+0000 mgr.smithi172.nqsqxd (mgr.14199) 700 : cluster 0 pgmap v603: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:31.220 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:31.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:31 smithi172 bash[24902]: audit 2023-12-07T17:24:29.432354+0000 mgr.smithi172.nqsqxd (mgr.14199) 701 : audit 0 from='client.14674 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:32 smithi172 bash[24902]: cluster 2023-12-07T17:24:30.390680+0000 mgr.smithi172.nqsqxd (mgr.14199) 702 : cluster 0 pgmap v604: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:34 smithi172 bash[24902]: cluster 2023-12-07T17:24:32.391366+0000 mgr.smithi172.nqsqxd (mgr.14199) 703 : cluster 0 pgmap v605: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:34 smithi172 bash[24902]: audit 2023-12-07T17:24:34.101138+0000 mon.smithi172 (mon.0) 636 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:24:36.015 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:36.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:36 smithi172 bash[24902]: cluster 2023-12-07T17:24:34.392121+0000 mgr.smithi172.nqsqxd (mgr.14199) 704 : cluster 0 pgmap v606: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:38.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:38 smithi172 bash[24902]: cluster 2023-12-07T17:24:36.392948+0000 mgr.smithi172.nqsqxd (mgr.14199) 705 : cluster 0 pgmap v607: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:39.555 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:39.556 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:40.321 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:40.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:40 smithi172 bash[24902]: cluster 2023-12-07T17:24:38.393656+0000 mgr.smithi172.nqsqxd (mgr.14199) 706 : cluster 0 pgmap v608: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:41.322 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:41.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:41 smithi172 bash[24902]: audit 2023-12-07T17:24:39.549667+0000 mgr.smithi172.nqsqxd (mgr.14199) 707 : audit 0 from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:42.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:42 smithi172 bash[24902]: cluster 2023-12-07T17:24:40.394337+0000 mgr.smithi172.nqsqxd (mgr.14199) 708 : cluster 0 pgmap v609: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:44.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:44 smithi172 bash[24902]: cluster 2023-12-07T17:24:42.395473+0000 mgr.smithi172.nqsqxd (mgr.14199) 709 : cluster 0 pgmap v610: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:46.117 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:46.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:46 smithi172 bash[24902]: cluster 2023-12-07T17:24:44.396174+0000 mgr.smithi172.nqsqxd (mgr.14199) 710 : cluster 0 pgmap v611: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:48.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:48 smithi172 bash[24902]: cluster 2023-12-07T17:24:46.396980+0000 mgr.smithi172.nqsqxd (mgr.14199) 711 : cluster 0 pgmap v612: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:49.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:49 smithi172 bash[24902]: audit 2023-12-07T17:24:49.101381+0000 mon.smithi172 (mon.0) 637 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:24:49.749 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:49.749 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:24:50.368 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:50 smithi172 bash[24902]: cluster 2023-12-07T17:24:48.397673+0000 mgr.smithi172.nqsqxd (mgr.14199) 712 : cluster 0 pgmap v613: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:50.551 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:24:51.553 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:24:51.565 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:51 smithi172 bash[24902]: audit 2023-12-07T17:24:49.740160+0000 mgr.smithi172.nqsqxd (mgr.14199) 713 : audit 0 from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:24:52.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:52 smithi172 bash[24902]: cluster 2023-12-07T17:24:50.398291+0000 mgr.smithi172.nqsqxd (mgr.14199) 714 : cluster 0 pgmap v614: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:54.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:54 smithi172 bash[24902]: cluster 2023-12-07T17:24:52.399189+0000 mgr.smithi172.nqsqxd (mgr.14199) 715 : cluster 0 pgmap v615: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:56.346 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:24:56.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:56 smithi172 bash[24902]: cluster 2023-12-07T17:24:54.399866+0000 mgr.smithi172.nqsqxd (mgr.14199) 716 : cluster 0 pgmap v616: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:58.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:24:58 smithi172 bash[24902]: cluster 2023-12-07T17:24:56.400727+0000 mgr.smithi172.nqsqxd (mgr.14199) 717 : cluster 0 pgmap v617: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:24:59.858 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:24:59.858 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:00.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:00 smithi172 bash[24902]: cluster 2023-12-07T17:24:58.401399+0000 mgr.smithi172.nqsqxd (mgr.14199) 718 : cluster 0 pgmap v618: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:00.725 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:01.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:01 smithi172 bash[24902]: audit 2023-12-07T17:24:59.846867+0000 mgr.smithi172.nqsqxd (mgr.14199) 719 : audit 0 from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:01.726 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:02.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:02 smithi172 bash[24902]: cluster 2023-12-07T17:25:00.401905+0000 mgr.smithi172.nqsqxd (mgr.14199) 720 : cluster 0 pgmap v619: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:04.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:04 smithi172 bash[24902]: cluster 2023-12-07T17:25:02.402740+0000 mgr.smithi172.nqsqxd (mgr.14199) 721 : cluster 0 pgmap v620: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:04 smithi172 bash[24902]: audit 2023-12-07T17:25:04.101965+0000 mon.smithi172 (mon.0) 638 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:25:06.512 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:06.538 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:06 smithi172 bash[24902]: cluster 2023-12-07T17:25:04.403350+0000 mgr.smithi172.nqsqxd (mgr.14199) 722 : cluster 0 pgmap v621: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:08.518 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:08 smithi172 bash[24902]: cluster 2023-12-07T17:25:06.403980+0000 mgr.smithi172.nqsqxd (mgr.14199) 723 : cluster 0 pgmap v622: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:09.915 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:09.916 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:10.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:10 smithi172 bash[24902]: cluster 2023-12-07T17:25:08.404339+0000 mgr.smithi172.nqsqxd (mgr.14199) 724 : cluster 0 pgmap v623: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:10.722 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:11.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:11 smithi172 bash[24902]: audit 2023-12-07T17:25:09.903464+0000 mgr.smithi172.nqsqxd (mgr.14199) 725 : audit 0 from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:11.723 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:12.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:12 smithi172 bash[24902]: cluster 2023-12-07T17:25:10.404792+0000 mgr.smithi172.nqsqxd (mgr.14199) 726 : cluster 0 pgmap v624: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:14.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:14 smithi172 bash[24902]: cluster 2023-12-07T17:25:12.405559+0000 mgr.smithi172.nqsqxd (mgr.14199) 727 : cluster 0 pgmap v625: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:16.511 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:16.544 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:16 smithi172 bash[24902]: cluster 2023-12-07T17:25:14.406177+0000 mgr.smithi172.nqsqxd (mgr.14199) 728 : cluster 0 pgmap v626: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:18.531 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:18 smithi172 bash[24902]: cluster 2023-12-07T17:25:16.407031+0000 mgr.smithi172.nqsqxd (mgr.14199) 729 : cluster 0 pgmap v627: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:19.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:19 smithi172 bash[24902]: audit 2023-12-07T17:25:19.101532+0000 mon.smithi172 (mon.0) 639 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:25:19.820 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:19.820 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:15:15.217417Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:15:15.216556Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:15:15.216851Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:15:15.217700Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:15:15.216212Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:15:15.215884Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:15:15.217135Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:15:15.218633Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:15:15.218321Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:15:15.219678Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:20 smithi172 bash[24902]: cluster 2023-12-07T17:25:18.407694+0000 mgr.smithi172.nqsqxd (mgr.14199) 730 : cluster 0 pgmap v628: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:20.635 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:21.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:21 smithi172 bash[24902]: audit 2023-12-07T17:25:19.808055+0000 mgr.smithi172.nqsqxd (mgr.14199) 731 : audit 0 from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:21.636 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:22 smithi172 bash[24902]: cluster 2023-12-07T17:25:20.408162+0000 mgr.smithi172.nqsqxd (mgr.14199) 732 : cluster 0 pgmap v629: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:23.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:23 smithi172 bash[24902]: audit 2023-12-07T17:25:22.442412+0000 mon.smithi172 (mon.0) 640 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:25:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:24 smithi172 bash[24902]: cluster 2023-12-07T17:25:22.408955+0000 mgr.smithi172.nqsqxd (mgr.14199) 733 : cluster 0 pgmap v630: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:26.432 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:26.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:26 smithi172 bash[24902]: cluster 2023-12-07T17:25:24.409453+0000 mgr.smithi172.nqsqxd (mgr.14199) 734 : cluster 0 pgmap v631: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:28.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:28 smithi172 bash[24902]: cluster 2023-12-07T17:25:26.410270+0000 mgr.smithi172.nqsqxd (mgr.14199) 735 : cluster 0 pgmap v632: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:29.724 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:29.724 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:30.500 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: cluster 2023-12-07T17:25:28.410777+0000 mgr.smithi172.nqsqxd (mgr.14199) 736 : cluster 0 pgmap v633: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:30.500 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: audit 2023-12-07T17:25:29.236580+0000 mon.smithi172 (mon.0) 641 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:25:30.500 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: audit 2023-12-07T17:25:29.244603+0000 mon.smithi172 (mon.0) 642 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:25:30.500 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: audit 2023-12-07T17:25:29.814368+0000 mon.smithi172 (mon.0) 643 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:25:30.500 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: audit 2023-12-07T17:25:29.815668+0000 mon.smithi172 (mon.0) 644 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:25:30.501 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:30 smithi172 bash[24902]: audit 2023-12-07T17:25:29.824552+0000 mon.smithi172 (mon.0) 645 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:25:30.502 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:31 smithi172 bash[24902]: audit 2023-12-07T17:25:29.715402+0000 mgr.smithi172.nqsqxd (mgr.14199) 737 : audit 0 from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:31 smithi172 bash[24902]: cluster 2023-12-07T17:25:29.818309+0000 mgr.smithi172.nqsqxd (mgr.14199) 738 : cluster 0 pgmap v634: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:31 smithi172 bash[24902]: cluster 2023-12-07T17:25:29.821515+0000 mgr.smithi172.nqsqxd (mgr.14199) 739 : cluster 0 pgmap v635: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:31.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:33.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:32 smithi172 bash[24902]: cluster 2023-12-07T17:25:31.822337+0000 mgr.smithi172.nqsqxd (mgr.14199) 740 : cluster 0 pgmap v636: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:35.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:34 smithi172 bash[24902]: cluster 2023-12-07T17:25:33.823018+0000 mgr.smithi172.nqsqxd (mgr.14199) 741 : cluster 0 pgmap v637: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:35.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:34 smithi172 bash[24902]: audit 2023-12-07T17:25:34.102512+0000 mon.smithi172 (mon.0) 646 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:25:36.300 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:37.277 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:36 smithi172 bash[24902]: cluster 2023-12-07T17:25:35.823649+0000 mgr.smithi172.nqsqxd (mgr.14199) 742 : cluster 0 pgmap v638: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:39.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:38 smithi172 bash[24902]: cluster 2023-12-07T17:25:37.824248+0000 mgr.smithi172.nqsqxd (mgr.14199) 743 : cluster 0 pgmap v639: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:39.526 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:39.526 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:40.274 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:41.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:41.289 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:40 smithi172 bash[24902]: audit 2023-12-07T17:25:39.515539+0000 mgr.smithi172.nqsqxd (mgr.14199) 744 : audit 0 from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:41.289 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:40 smithi172 bash[24902]: cluster 2023-12-07T17:25:39.824886+0000 mgr.smithi172.nqsqxd (mgr.14199) 745 : cluster 0 pgmap v640: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:43.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:42 smithi172 bash[24902]: cluster 2023-12-07T17:25:41.825677+0000 mgr.smithi172.nqsqxd (mgr.14199) 746 : cluster 0 pgmap v641: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:45.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:44 smithi172 bash[24902]: cluster 2023-12-07T17:25:43.826336+0000 mgr.smithi172.nqsqxd (mgr.14199) 747 : cluster 0 pgmap v642: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:46.078 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:47.192 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:46 smithi172 bash[24902]: cluster 2023-12-07T17:25:45.826964+0000 mgr.smithi172.nqsqxd (mgr.14199) 748 : cluster 0 pgmap v643: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:49.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:48 smithi172 bash[24902]: cluster 2023-12-07T17:25:47.827802+0000 mgr.smithi172.nqsqxd (mgr.14199) 749 : cluster 0 pgmap v644: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:49.453 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:49.454 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:25:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:49 smithi172 bash[24902]: audit 2023-12-07T17:25:49.102610+0000 mon.smithi172 (mon.0) 647 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:25:50.305 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:25:51.307 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:25:51.321 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:50 smithi172 bash[24902]: audit 2023-12-07T17:25:49.443782+0000 mgr.smithi172.nqsqxd (mgr.14199) 750 : audit 0 from='client.14690 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:25:51.321 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:50 smithi172 bash[24902]: cluster 2023-12-07T17:25:49.828548+0000 mgr.smithi172.nqsqxd (mgr.14199) 751 : cluster 0 pgmap v645: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:53.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:52 smithi172 bash[24902]: cluster 2023-12-07T17:25:51.829485+0000 mgr.smithi172.nqsqxd (mgr.14199) 752 : cluster 0 pgmap v646: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:55.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:54 smithi172 bash[24902]: cluster 2023-12-07T17:25:53.830221+0000 mgr.smithi172.nqsqxd (mgr.14199) 753 : cluster 0 pgmap v647: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:56.100 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:25:57.196 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:56 smithi172 bash[24902]: cluster 2023-12-07T17:25:55.830890+0000 mgr.smithi172.nqsqxd (mgr.14199) 754 : cluster 0 pgmap v648: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:59.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:25:58 smithi172 bash[24902]: cluster 2023-12-07T17:25:57.831668+0000 mgr.smithi172.nqsqxd (mgr.14199) 755 : cluster 0 pgmap v649: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:25:59.518 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:25:59.518 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:00.378 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:01.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:00 smithi172 bash[24902]: audit 2023-12-07T17:25:59.508497+0000 mgr.smithi172.nqsqxd (mgr.14199) 756 : audit 0 from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:01.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:00 smithi172 bash[24902]: cluster 2023-12-07T17:25:59.832327+0000 mgr.smithi172.nqsqxd (mgr.14199) 757 : cluster 0 pgmap v650: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:01.379 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:03.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:02 smithi172 bash[24902]: cluster 2023-12-07T17:26:01.833174+0000 mgr.smithi172.nqsqxd (mgr.14199) 758 : cluster 0 pgmap v651: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:04 smithi172 bash[24902]: cluster 2023-12-07T17:26:03.833826+0000 mgr.smithi172.nqsqxd (mgr.14199) 759 : cluster 0 pgmap v652: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:04 smithi172 bash[24902]: audit 2023-12-07T17:26:04.103339+0000 mon.smithi172 (mon.0) 648 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:26:06.179 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:07.072 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:06 smithi172 bash[24902]: cluster 2023-12-07T17:26:05.834535+0000 mgr.smithi172.nqsqxd (mgr.14199) 760 : cluster 0 pgmap v653: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:09.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:08 smithi172 bash[24902]: cluster 2023-12-07T17:26:07.835367+0000 mgr.smithi172.nqsqxd (mgr.14199) 761 : cluster 0 pgmap v654: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:09.521 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:09.521 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:10.365 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:11.366 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:11.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:10 smithi172 bash[24902]: audit 2023-12-07T17:26:09.511361+0000 mgr.smithi172.nqsqxd (mgr.14199) 762 : audit 0 from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:11.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:10 smithi172 bash[24902]: cluster 2023-12-07T17:26:09.835982+0000 mgr.smithi172.nqsqxd (mgr.14199) 763 : cluster 0 pgmap v655: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:13.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:12 smithi172 bash[24902]: cluster 2023-12-07T17:26:11.836813+0000 mgr.smithi172.nqsqxd (mgr.14199) 764 : cluster 0 pgmap v656: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:15.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:14 smithi172 bash[24902]: cluster 2023-12-07T17:26:13.837550+0000 mgr.smithi172.nqsqxd (mgr.14199) 765 : cluster 0 pgmap v657: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:16.156 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:17.170 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:16 smithi172 bash[24902]: cluster 2023-12-07T17:26:15.838327+0000 mgr.smithi172.nqsqxd (mgr.14199) 766 : cluster 0 pgmap v658: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:19.169 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:18 smithi172 bash[24902]: cluster 2023-12-07T17:26:17.839068+0000 mgr.smithi172.nqsqxd (mgr.14199) 767 : cluster 0 pgmap v659: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:19.669 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:19.669 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:20.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:19 smithi172 bash[24902]: audit 2023-12-07T17:26:19.103590+0000 mon.smithi172 (mon.0) 649 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:26:20.541 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:20 smithi172 bash[24902]: audit 2023-12-07T17:26:19.658742+0000 mgr.smithi172.nqsqxd (mgr.14199) 768 : audit 0 from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:20 smithi172 bash[24902]: cluster 2023-12-07T17:26:19.839733+0000 mgr.smithi172.nqsqxd (mgr.14199) 769 : cluster 0 pgmap v660: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:21.542 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:23.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:22 smithi172 bash[24902]: cluster 2023-12-07T17:26:21.840519+0000 mgr.smithi172.nqsqxd (mgr.14199) 770 : cluster 0 pgmap v661: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:25.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:24 smithi172 bash[24902]: cluster 2023-12-07T17:26:23.841206+0000 mgr.smithi172.nqsqxd (mgr.14199) 771 : cluster 0 pgmap v662: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:26.339 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:27.277 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:26 smithi172 bash[24902]: cluster 2023-12-07T17:26:25.841832+0000 mgr.smithi172.nqsqxd (mgr.14199) 772 : cluster 0 pgmap v663: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:29.212 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:28 smithi172 bash[24902]: cluster 2023-12-07T17:26:27.842439+0000 mgr.smithi172.nqsqxd (mgr.14199) 773 : cluster 0 pgmap v664: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:29.700 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:29.700 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:30.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:29 smithi172 bash[24902]: audit 2023-12-07T17:26:29.873978+0000 mon.smithi172 (mon.0) 650 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:26:30.516 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:30 smithi172 bash[24902]: audit 2023-12-07T17:26:29.690153+0000 mgr.smithi172.nqsqxd (mgr.14199) 774 : audit 0 from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:30 smithi172 bash[24902]: cluster 2023-12-07T17:26:29.843095+0000 mgr.smithi172.nqsqxd (mgr.14199) 775 : cluster 0 pgmap v665: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:30 smithi172 bash[24902]: audit 2023-12-07T17:26:30.502774+0000 mon.smithi172 (mon.0) 651 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:26:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:30 smithi172 bash[24902]: audit 2023-12-07T17:26:30.504593+0000 mon.smithi172 (mon.0) 652 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:26:31.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:30 smithi172 bash[24902]: audit 2023-12-07T17:26:30.512559+0000 mon.smithi172 (mon.0) 653 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:26:31.517 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:32.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:31 smithi172 bash[24902]: cluster 2023-12-07T17:26:30.507369+0000 mgr.smithi172.nqsqxd (mgr.14199) 776 : cluster 0 pgmap v666: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:32.215 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:31 smithi172 bash[24902]: cluster 2023-12-07T17:26:30.507754+0000 mgr.smithi172.nqsqxd (mgr.14199) 777 : cluster 0 pgmap v667: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:33 smithi172 bash[24902]: cluster 2023-12-07T17:26:32.508552+0000 mgr.smithi172.nqsqxd (mgr.14199) 778 : cluster 0 pgmap v668: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:35.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:34 smithi172 bash[24902]: audit 2023-12-07T17:26:34.104101+0000 mon.smithi172 (mon.0) 654 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:26:36.320 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:36.351 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:35 smithi172 bash[24902]: cluster 2023-12-07T17:26:34.509204+0000 mgr.smithi172.nqsqxd (mgr.14199) 779 : cluster 0 pgmap v669: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:38.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:37 smithi172 bash[24902]: cluster 2023-12-07T17:26:36.509961+0000 mgr.smithi172.nqsqxd (mgr.14199) 780 : cluster 0 pgmap v670: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:39.728 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:39.728 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:40.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:39 smithi172 bash[24902]: cluster 2023-12-07T17:26:38.510540+0000 mgr.smithi172.nqsqxd (mgr.14199) 781 : cluster 0 pgmap v671: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:40.532 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:41.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:40 smithi172 bash[24902]: audit 2023-12-07T17:26:39.718374+0000 mgr.smithi172.nqsqxd (mgr.14199) 782 : audit 0 from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:41.533 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:42.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:41 smithi172 bash[24902]: cluster 2023-12-07T17:26:40.511184+0000 mgr.smithi172.nqsqxd (mgr.14199) 783 : cluster 0 pgmap v672: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:44.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:43 smithi172 bash[24902]: cluster 2023-12-07T17:26:42.511874+0000 mgr.smithi172.nqsqxd (mgr.14199) 784 : cluster 0 pgmap v673: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:46.331 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:46.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:45 smithi172 bash[24902]: cluster 2023-12-07T17:26:44.512536+0000 mgr.smithi172.nqsqxd (mgr.14199) 785 : cluster 0 pgmap v674: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:48.254 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:47 smithi172 bash[24902]: cluster 2023-12-07T17:26:46.513355+0000 mgr.smithi172.nqsqxd (mgr.14199) 786 : cluster 0 pgmap v675: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:49.636 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:49.636 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:26:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:49 smithi172 bash[24902]: cluster 2023-12-07T17:26:48.514030+0000 mgr.smithi172.nqsqxd (mgr.14199) 787 : cluster 0 pgmap v676: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:49 smithi172 bash[24902]: audit 2023-12-07T17:26:49.103957+0000 mon.smithi172 (mon.0) 655 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:26:50.429 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:26:51.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:50 smithi172 bash[24902]: audit 2023-12-07T17:26:49.625295+0000 mgr.smithi172.nqsqxd (mgr.14199) 788 : audit 0 from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:26:51.430 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:26:52.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:51 smithi172 bash[24902]: cluster 2023-12-07T17:26:50.514746+0000 mgr.smithi172.nqsqxd (mgr.14199) 789 : cluster 0 pgmap v677: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:54.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:53 smithi172 bash[24902]: cluster 2023-12-07T17:26:52.515568+0000 mgr.smithi172.nqsqxd (mgr.14199) 790 : cluster 0 pgmap v678: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:56.230 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:26:56.258 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:55 smithi172 bash[24902]: cluster 2023-12-07T17:26:54.516347+0000 mgr.smithi172.nqsqxd (mgr.14199) 791 : cluster 0 pgmap v679: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:58.257 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:57 smithi172 bash[24902]: cluster 2023-12-07T17:26:56.517220+0000 mgr.smithi172.nqsqxd (mgr.14199) 792 : cluster 0 pgmap v680: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:26:59.705 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:26:59.705 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:00.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:26:59 smithi172 bash[24902]: cluster 2023-12-07T17:26:58.517902+0000 mgr.smithi172.nqsqxd (mgr.14199) 793 : cluster 0 pgmap v681: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:00.583 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:01.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:00 smithi172 bash[24902]: audit 2023-12-07T17:26:59.693421+0000 mgr.smithi172.nqsqxd (mgr.14199) 794 : audit 0 from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:01.584 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:02.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:01 smithi172 bash[24902]: cluster 2023-12-07T17:27:00.518711+0000 mgr.smithi172.nqsqxd (mgr.14199) 795 : cluster 0 pgmap v682: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:04.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:03 smithi172 bash[24902]: cluster 2023-12-07T17:27:02.519534+0000 mgr.smithi172.nqsqxd (mgr.14199) 796 : cluster 0 pgmap v683: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:05.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:04 smithi172 bash[24902]: audit 2023-12-07T17:27:04.104952+0000 mon.smithi172 (mon.0) 656 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:27:06.376 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:06.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:05 smithi172 bash[24902]: cluster 2023-12-07T17:27:04.520311+0000 mgr.smithi172.nqsqxd (mgr.14199) 797 : cluster 0 pgmap v684: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:08.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:07 smithi172 bash[24902]: cluster 2023-12-07T17:27:06.521150+0000 mgr.smithi172.nqsqxd (mgr.14199) 798 : cluster 0 pgmap v685: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:09.724 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:09.724 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:10.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:09 smithi172 bash[24902]: cluster 2023-12-07T17:27:08.521785+0000 mgr.smithi172.nqsqxd (mgr.14199) 799 : cluster 0 pgmap v686: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:10.557 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:11.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:10 smithi172 bash[24902]: audit 2023-12-07T17:27:09.711783+0000 mgr.smithi172.nqsqxd (mgr.14199) 800 : audit 0 from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:11.557 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:12.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:11 smithi172 bash[24902]: cluster 2023-12-07T17:27:10.522428+0000 mgr.smithi172.nqsqxd (mgr.14199) 801 : cluster 0 pgmap v687: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:14.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:13 smithi172 bash[24902]: cluster 2023-12-07T17:27:12.523227+0000 mgr.smithi172.nqsqxd (mgr.14199) 802 : cluster 0 pgmap v688: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:16.353 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:16.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:15 smithi172 bash[24902]: cluster 2023-12-07T17:27:14.523930+0000 mgr.smithi172.nqsqxd (mgr.14199) 803 : cluster 0 pgmap v689: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:18.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:17 smithi172 bash[24902]: cluster 2023-12-07T17:27:16.524867+0000 mgr.smithi172.nqsqxd (mgr.14199) 804 : cluster 0 pgmap v690: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:19.777 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:19.777 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:20.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:19 smithi172 bash[24902]: cluster 2023-12-07T17:27:18.525422+0000 mgr.smithi172.nqsqxd (mgr.14199) 805 : cluster 0 pgmap v691: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:20.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:19 smithi172 bash[24902]: audit 2023-12-07T17:27:19.105271+0000 mon.smithi172 (mon.0) 657 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:27:20.626 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:21.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:20 smithi172 bash[24902]: audit 2023-12-07T17:27:19.766266+0000 mgr.smithi172.nqsqxd (mgr.14199) 806 : audit 0 from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:21.628 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:22.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:21 smithi172 bash[24902]: cluster 2023-12-07T17:27:20.526006+0000 mgr.smithi172.nqsqxd (mgr.14199) 807 : cluster 0 pgmap v692: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:24.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:23 smithi172 bash[24902]: cluster 2023-12-07T17:27:22.526898+0000 mgr.smithi172.nqsqxd (mgr.14199) 808 : cluster 0 pgmap v693: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:26.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:25 smithi172 bash[24902]: cluster 2023-12-07T17:27:24.527584+0000 mgr.smithi172.nqsqxd (mgr.14199) 809 : cluster 0 pgmap v694: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:26.427 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:28.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:27 smithi172 bash[24902]: cluster 2023-12-07T17:27:26.528394+0000 mgr.smithi172.nqsqxd (mgr.14199) 810 : cluster 0 pgmap v695: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:29.721 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:29.721 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:30.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:29 smithi172 bash[24902]: cluster 2023-12-07T17:27:28.529094+0000 mgr.smithi172.nqsqxd (mgr.14199) 811 : cluster 0 pgmap v696: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:30.575 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:31 smithi172 bash[24902]: audit 2023-12-07T17:27:29.709950+0000 mgr.smithi172.nqsqxd (mgr.14199) 812 : audit 0 from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:31.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:31 smithi172 bash[24902]: audit 2023-12-07T17:27:30.562741+0000 mon.smithi172 (mon.0) 658 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:27:31.576 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:32.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: cluster 2023-12-07T17:27:30.529750+0000 mgr.smithi172.nqsqxd (mgr.14199) 813 : cluster 0 pgmap v697: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:32.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: audit 2023-12-07T17:27:31.187020+0000 mon.smithi172 (mon.0) 659 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:27:32.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: audit 2023-12-07T17:27:31.188784+0000 mon.smithi172 (mon.0) 660 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:27:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: cluster 2023-12-07T17:27:31.191376+0000 mgr.smithi172.nqsqxd (mgr.14199) 814 : cluster 0 pgmap v698: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: cluster 2023-12-07T17:27:31.191772+0000 mgr.smithi172.nqsqxd (mgr.14199) 815 : cluster 0 pgmap v699: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:32 smithi172 bash[24902]: audit 2023-12-07T17:27:31.197489+0000 mon.smithi172 (mon.0) 661 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:27:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:34 smithi172 bash[24902]: cluster 2023-12-07T17:27:33.192495+0000 mgr.smithi172.nqsqxd (mgr.14199) 816 : cluster 0 pgmap v700: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:34 smithi172 bash[24902]: audit 2023-12-07T17:27:34.105722+0000 mon.smithi172 (mon.0) 662 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:27:36.369 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:36.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:36 smithi172 bash[24902]: cluster 2023-12-07T17:27:35.193157+0000 mgr.smithi172.nqsqxd (mgr.14199) 817 : cluster 0 pgmap v701: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:37.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:37 smithi172 bash[24902]: cluster 2023-12-07T17:27:37.194031+0000 mgr.smithi172.nqsqxd (mgr.14199) 818 : cluster 0 pgmap v702: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:39.832 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:39.832 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:40.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:40 smithi172 bash[24902]: cluster 2023-12-07T17:27:39.194734+0000 mgr.smithi172.nqsqxd (mgr.14199) 819 : cluster 0 pgmap v703: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:40.653 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:41.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:41 smithi172 bash[24902]: audit 2023-12-07T17:27:39.822416+0000 mgr.smithi172.nqsqxd (mgr.14199) 820 : audit 0 from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:41.655 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:42.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:42 smithi172 bash[24902]: cluster 2023-12-07T17:27:41.195481+0000 mgr.smithi172.nqsqxd (mgr.14199) 821 : cluster 0 pgmap v704: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:44.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:44 smithi172 bash[24902]: cluster 2023-12-07T17:27:43.196229+0000 mgr.smithi172.nqsqxd (mgr.14199) 822 : cluster 0 pgmap v705: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:46.447 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:46.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:46 smithi172 bash[24902]: cluster 2023-12-07T17:27:45.196874+0000 mgr.smithi172.nqsqxd (mgr.14199) 823 : cluster 0 pgmap v706: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:48.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:47 smithi172 bash[24902]: cluster 2023-12-07T17:27:47.197540+0000 mgr.smithi172.nqsqxd (mgr.14199) 824 : cluster 0 pgmap v707: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:49.456 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:49 smithi172 bash[24902]: audit 2023-12-07T17:27:49.105990+0000 mon.smithi172 (mon.0) 663 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:27:49.868 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:49.868 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:27:50.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:50 smithi172 bash[24902]: cluster 2023-12-07T17:27:49.198168+0000 mgr.smithi172.nqsqxd (mgr.14199) 825 : cluster 0 pgmap v708: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:50.666 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:27:51.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:51 smithi172 bash[24902]: audit 2023-12-07T17:27:49.858663+0000 mgr.smithi172.nqsqxd (mgr.14199) 826 : audit 0 from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:27:51.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:27:52.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:52 smithi172 bash[24902]: cluster 2023-12-07T17:27:51.198936+0000 mgr.smithi172.nqsqxd (mgr.14199) 827 : cluster 0 pgmap v709: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:54.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:54 smithi172 bash[24902]: cluster 2023-12-07T17:27:53.199655+0000 mgr.smithi172.nqsqxd (mgr.14199) 828 : cluster 0 pgmap v710: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:56.463 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:27:56.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:56 smithi172 bash[24902]: cluster 2023-12-07T17:27:55.200366+0000 mgr.smithi172.nqsqxd (mgr.14199) 829 : cluster 0 pgmap v711: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:58.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:27:57 smithi172 bash[24902]: cluster 2023-12-07T17:27:57.201215+0000 mgr.smithi172.nqsqxd (mgr.14199) 830 : cluster 0 pgmap v712: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:27:59.845 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:27:59.846 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:00.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:00 smithi172 bash[24902]: cluster 2023-12-07T17:27:59.201721+0000 mgr.smithi172.nqsqxd (mgr.14199) 831 : cluster 0 pgmap v713: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:00.645 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:01.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:01 smithi172 bash[24902]: audit 2023-12-07T17:27:59.839663+0000 mgr.smithi172.nqsqxd (mgr.14199) 832 : audit 0 from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:01.646 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:02.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:02 smithi172 bash[24902]: cluster 2023-12-07T17:28:01.202449+0000 mgr.smithi172.nqsqxd (mgr.14199) 833 : cluster 0 pgmap v714: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:04.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:04 smithi172 bash[24902]: cluster 2023-12-07T17:28:03.203220+0000 mgr.smithi172.nqsqxd (mgr.14199) 834 : cluster 0 pgmap v715: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:04.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:04 smithi172 bash[24902]: audit 2023-12-07T17:28:04.106499+0000 mon.smithi172 (mon.0) 664 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:28:06.444 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:06.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:06 smithi172 bash[24902]: cluster 2023-12-07T17:28:05.203877+0000 mgr.smithi172.nqsqxd (mgr.14199) 835 : cluster 0 pgmap v716: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:07.973 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:07 smithi172 bash[24902]: cluster 2023-12-07T17:28:07.204708+0000 mgr.smithi172.nqsqxd (mgr.14199) 836 : cluster 0 pgmap v717: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:09.788 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:09.788 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:10.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:10 smithi172 bash[24902]: cluster 2023-12-07T17:28:09.205346+0000 mgr.smithi172.nqsqxd (mgr.14199) 837 : cluster 0 pgmap v718: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:10.611 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:11.613 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:11.625 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:11 smithi172 bash[24902]: audit 2023-12-07T17:28:09.778212+0000 mgr.smithi172.nqsqxd (mgr.14199) 838 : audit 0 from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:12.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:12 smithi172 bash[24902]: cluster 2023-12-07T17:28:11.206070+0000 mgr.smithi172.nqsqxd (mgr.14199) 839 : cluster 0 pgmap v719: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:14.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:14 smithi172 bash[24902]: cluster 2023-12-07T17:28:13.206813+0000 mgr.smithi172.nqsqxd (mgr.14199) 840 : cluster 0 pgmap v720: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:16.407 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:16.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:16 smithi172 bash[24902]: cluster 2023-12-07T17:28:15.207438+0000 mgr.smithi172.nqsqxd (mgr.14199) 841 : cluster 0 pgmap v721: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:17.876 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:17 smithi172 bash[24902]: cluster 2023-12-07T17:28:17.208234+0000 mgr.smithi172.nqsqxd (mgr.14199) 842 : cluster 0 pgmap v722: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:19.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:19 smithi172 bash[24902]: audit 2023-12-07T17:28:19.106732+0000 mon.smithi172 (mon.0) 665 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:28:19.754 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:19.754 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:20.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:20 smithi172 bash[24902]: cluster 2023-12-07T17:28:19.208652+0000 mgr.smithi172.nqsqxd (mgr.14199) 843 : cluster 0 pgmap v723: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:20.652 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:21.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:21 smithi172 bash[24902]: audit 2023-12-07T17:28:19.747590+0000 mgr.smithi172.nqsqxd (mgr.14199) 844 : audit 0 from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:21.653 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:22.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:22 smithi172 bash[24902]: cluster 2023-12-07T17:28:21.209311+0000 mgr.smithi172.nqsqxd (mgr.14199) 845 : cluster 0 pgmap v724: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:24.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:24 smithi172 bash[24902]: cluster 2023-12-07T17:28:23.210061+0000 mgr.smithi172.nqsqxd (mgr.14199) 846 : cluster 0 pgmap v725: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:26.456 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:26.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:26 smithi172 bash[24902]: cluster 2023-12-07T17:28:25.210723+0000 mgr.smithi172.nqsqxd (mgr.14199) 847 : cluster 0 pgmap v726: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:27.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:27 smithi172 bash[24902]: cluster 2023-12-07T17:28:27.211482+0000 mgr.smithi172.nqsqxd (mgr.14199) 848 : cluster 0 pgmap v727: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:29.699 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:29.699 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:30.493 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:30.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:30 smithi172 bash[24902]: cluster 2023-12-07T17:28:29.212086+0000 mgr.smithi172.nqsqxd (mgr.14199) 849 : cluster 0 pgmap v728: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:31.495 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:31.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:31 smithi172 bash[24902]: audit 2023-12-07T17:28:29.689066+0000 mgr.smithi172.nqsqxd (mgr.14199) 850 : audit 0 from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:31.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:31 smithi172 bash[24902]: audit 2023-12-07T17:28:31.247302+0000 mon.smithi172 (mon.0) 666 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:28:32.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:32 smithi172 bash[24902]: cluster 2023-12-07T17:28:31.212832+0000 mgr.smithi172.nqsqxd (mgr.14199) 851 : cluster 0 pgmap v729: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:32 smithi172 bash[24902]: audit 2023-12-07T17:28:31.869502+0000 mon.smithi172 (mon.0) 667 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:32 smithi172 bash[24902]: audit 2023-12-07T17:28:31.871262+0000 mon.smithi172 (mon.0) 668 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:28:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:32 smithi172 bash[24902]: audit 2023-12-07T17:28:31.883311+0000 mon.smithi172 (mon.0) 669 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:28:33.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:33 smithi172 bash[24902]: cluster 2023-12-07T17:28:31.874247+0000 mgr.smithi172.nqsqxd (mgr.14199) 852 : cluster 0 pgmap v730: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:33.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:33 smithi172 bash[24902]: cluster 2023-12-07T17:28:31.874762+0000 mgr.smithi172.nqsqxd (mgr.14199) 853 : cluster 0 pgmap v731: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:34.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:34 smithi172 bash[24902]: audit 2023-12-07T17:28:34.107218+0000 mon.smithi172 (mon.0) 670 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:28:35.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:35 smithi172 bash[24902]: cluster 2023-12-07T17:28:33.875333+0000 mgr.smithi172.nqsqxd (mgr.14199) 854 : cluster 0 pgmap v732: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:36.276 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:37.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:37 smithi172 bash[24902]: cluster 2023-12-07T17:28:35.875997+0000 mgr.smithi172.nqsqxd (mgr.14199) 855 : cluster 0 pgmap v733: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:39.465 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:39 smithi172 bash[24902]: cluster 2023-12-07T17:28:37.876851+0000 mgr.smithi172.nqsqxd (mgr.14199) 856 : cluster 0 pgmap v734: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:39.666 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:39.666 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:40.503 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:41.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:41.626 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:41 smithi172 bash[24902]: audit 2023-12-07T17:28:39.655103+0000 mgr.smithi172.nqsqxd (mgr.14199) 857 : audit 0 from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:41.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:41 smithi172 bash[24902]: cluster 2023-12-07T17:28:39.877516+0000 mgr.smithi172.nqsqxd (mgr.14199) 858 : cluster 0 pgmap v735: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:43.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:42 smithi172 bash[24902]: cluster 2023-12-07T17:28:41.878293+0000 mgr.smithi172.nqsqxd (mgr.14199) 859 : cluster 0 pgmap v736: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:45.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:44 smithi172 bash[24902]: cluster 2023-12-07T17:28:43.878963+0000 mgr.smithi172.nqsqxd (mgr.14199) 860 : cluster 0 pgmap v737: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:46.306 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:47.259 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:46 smithi172 bash[24902]: cluster 2023-12-07T17:28:45.879591+0000 mgr.smithi172.nqsqxd (mgr.14199) 861 : cluster 0 pgmap v738: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:49.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:48 smithi172 bash[24902]: cluster 2023-12-07T17:28:47.880394+0000 mgr.smithi172.nqsqxd (mgr.14199) 862 : cluster 0 pgmap v739: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:49.488 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:49.488 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:28:50.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:49 smithi172 bash[24902]: audit 2023-12-07T17:28:49.107133+0000 mon.smithi172 (mon.0) 671 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:28:50.375 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:28:51.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:28:51.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:50 smithi172 bash[24902]: audit 2023-12-07T17:28:49.481542+0000 mgr.smithi172.nqsqxd (mgr.14199) 863 : audit 0 from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:28:51.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:50 smithi172 bash[24902]: cluster 2023-12-07T17:28:49.881042+0000 mgr.smithi172.nqsqxd (mgr.14199) 864 : cluster 0 pgmap v740: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:53.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:52 smithi172 bash[24902]: cluster 2023-12-07T17:28:51.881892+0000 mgr.smithi172.nqsqxd (mgr.14199) 865 : cluster 0 pgmap v741: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:55.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:54 smithi172 bash[24902]: cluster 2023-12-07T17:28:53.882595+0000 mgr.smithi172.nqsqxd (mgr.14199) 866 : cluster 0 pgmap v742: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:56.170 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:28:57.225 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:56 smithi172 bash[24902]: cluster 2023-12-07T17:28:55.883273+0000 mgr.smithi172.nqsqxd (mgr.14199) 867 : cluster 0 pgmap v743: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:59.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:28:58 smithi172 bash[24902]: cluster 2023-12-07T17:28:57.883883+0000 mgr.smithi172.nqsqxd (mgr.14199) 868 : cluster 0 pgmap v744: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:28:59.556 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:28:59.556 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:00.451 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:01.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:00 smithi172 bash[24902]: audit 2023-12-07T17:28:59.543031+0000 mgr.smithi172.nqsqxd (mgr.14199) 869 : audit 0 from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:01.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:00 smithi172 bash[24902]: cluster 2023-12-07T17:28:59.884224+0000 mgr.smithi172.nqsqxd (mgr.14199) 870 : cluster 0 pgmap v745: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:01.452 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:03.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:02 smithi172 bash[24902]: cluster 2023-12-07T17:29:01.885019+0000 mgr.smithi172.nqsqxd (mgr.14199) 871 : cluster 0 pgmap v746: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:04 smithi172 bash[24902]: cluster 2023-12-07T17:29:03.885674+0000 mgr.smithi172.nqsqxd (mgr.14199) 872 : cluster 0 pgmap v747: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:04 smithi172 bash[24902]: audit 2023-12-07T17:29:04.108146+0000 mon.smithi172 (mon.0) 672 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:29:06.253 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:07.276 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:06 smithi172 bash[24902]: cluster 2023-12-07T17:29:05.886394+0000 mgr.smithi172.nqsqxd (mgr.14199) 873 : cluster 0 pgmap v748: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:09.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:08 smithi172 bash[24902]: cluster 2023-12-07T17:29:07.887398+0000 mgr.smithi172.nqsqxd (mgr.14199) 874 : cluster 0 pgmap v749: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:09.583 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:09.584 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:10.445 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:11.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:10 smithi172 bash[24902]: audit 2023-12-07T17:29:09.574231+0000 mgr.smithi172.nqsqxd (mgr.14199) 875 : audit 0 from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:11.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:10 smithi172 bash[24902]: cluster 2023-12-07T17:29:09.887960+0000 mgr.smithi172.nqsqxd (mgr.14199) 876 : cluster 0 pgmap v750: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:11.446 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:13.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:12 smithi172 bash[24902]: cluster 2023-12-07T17:29:11.888766+0000 mgr.smithi172.nqsqxd (mgr.14199) 877 : cluster 0 pgmap v751: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:15.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:14 smithi172 bash[24902]: cluster 2023-12-07T17:29:13.889443+0000 mgr.smithi172.nqsqxd (mgr.14199) 878 : cluster 0 pgmap v752: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:16.241 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:17.277 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:16 smithi172 bash[24902]: cluster 2023-12-07T17:29:15.890124+0000 mgr.smithi172.nqsqxd (mgr.14199) 879 : cluster 0 pgmap v753: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:19.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:18 smithi172 bash[24902]: cluster 2023-12-07T17:29:17.890933+0000 mgr.smithi172.nqsqxd (mgr.14199) 880 : cluster 0 pgmap v754: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:19.592 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:19.592 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:20.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:19 smithi172 bash[24902]: audit 2023-12-07T17:29:19.108434+0000 mon.smithi172 (mon.0) 673 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:29:20.395 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:21.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:20 smithi172 bash[24902]: audit 2023-12-07T17:29:19.586001+0000 mgr.smithi172.nqsqxd (mgr.14199) 881 : audit 0 from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:21.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:20 smithi172 bash[24902]: cluster 2023-12-07T17:29:19.891553+0000 mgr.smithi172.nqsqxd (mgr.14199) 882 : cluster 0 pgmap v755: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:21.396 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:23.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:22 smithi172 bash[24902]: cluster 2023-12-07T17:29:21.892374+0000 mgr.smithi172.nqsqxd (mgr.14199) 883 : cluster 0 pgmap v756: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:25.237 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:24 smithi172 bash[24902]: cluster 2023-12-07T17:29:23.893000+0000 mgr.smithi172.nqsqxd (mgr.14199) 884 : cluster 0 pgmap v757: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:26.189 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:27.209 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:26 smithi172 bash[24902]: cluster 2023-12-07T17:29:25.893647+0000 mgr.smithi172.nqsqxd (mgr.14199) 885 : cluster 0 pgmap v758: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:29.376 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:28 smithi172 bash[24902]: cluster 2023-12-07T17:29:27.894339+0000 mgr.smithi172.nqsqxd (mgr.14199) 886 : cluster 0 pgmap v759: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:29.462 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:29.462 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:30.255 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:31.257 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:31.269 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:30 smithi172 bash[24902]: audit 2023-12-07T17:29:29.451061+0000 mgr.smithi172.nqsqxd (mgr.14199) 887 : audit 0 from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:31.270 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:30 smithi172 bash[24902]: cluster 2023-12-07T17:29:29.894923+0000 mgr.smithi172.nqsqxd (mgr.14199) 888 : cluster 0 pgmap v760: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:33.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:32 smithi172 bash[24902]: cluster 2023-12-07T17:29:31.895658+0000 mgr.smithi172.nqsqxd (mgr.14199) 889 : cluster 0 pgmap v761: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:33.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:32 smithi172 bash[24902]: audit 2023-12-07T17:29:31.934023+0000 mon.smithi172 (mon.0) 674 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:29:33.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:32 smithi172 bash[24902]: audit 2023-12-07T17:29:32.559083+0000 mon.smithi172 (mon.0) 675 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:29:33.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:32 smithi172 bash[24902]: audit 2023-12-07T17:29:32.560590+0000 mon.smithi172 (mon.0) 676 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:29:33.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:32 smithi172 bash[24902]: audit 2023-12-07T17:29:32.569042+0000 mon.smithi172 (mon.0) 677 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:29:34.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:33 smithi172 bash[24902]: cluster 2023-12-07T17:29:32.563090+0000 mgr.smithi172.nqsqxd (mgr.14199) 890 : cluster 0 pgmap v762: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:34.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:33 smithi172 bash[24902]: cluster 2023-12-07T17:29:32.563528+0000 mgr.smithi172.nqsqxd (mgr.14199) 891 : cluster 0 pgmap v763: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:35.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:34 smithi172 bash[24902]: audit 2023-12-07T17:29:34.108972+0000 mon.smithi172 (mon.0) 678 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:29:36.046 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:36.075 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:35 smithi172 bash[24902]: cluster 2023-12-07T17:29:34.564223+0000 mgr.smithi172.nqsqxd (mgr.14199) 892 : cluster 0 pgmap v764: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:38.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:37 smithi172 bash[24902]: cluster 2023-12-07T17:29:36.565040+0000 mgr.smithi172.nqsqxd (mgr.14199) 893 : cluster 0 pgmap v765: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:39.517 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:39.517 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:40.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:39 smithi172 bash[24902]: cluster 2023-12-07T17:29:38.565692+0000 mgr.smithi172.nqsqxd (mgr.14199) 894 : cluster 0 pgmap v766: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:40.295 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:41.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:40 smithi172 bash[24902]: audit 2023-12-07T17:29:39.505271+0000 mgr.smithi172.nqsqxd (mgr.14199) 895 : audit 0 from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:41.296 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:42.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:41 smithi172 bash[24902]: cluster 2023-12-07T17:29:40.566248+0000 mgr.smithi172.nqsqxd (mgr.14199) 896 : cluster 0 pgmap v767: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:44.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:43 smithi172 bash[24902]: cluster 2023-12-07T17:29:42.567020+0000 mgr.smithi172.nqsqxd (mgr.14199) 897 : cluster 0 pgmap v768: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:45.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:45 smithi172 bash[24902]: cluster 2023-12-07T17:29:44.567568+0000 mgr.smithi172.nqsqxd (mgr.14199) 898 : cluster 0 pgmap v769: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:46.091 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:48.089 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:47 smithi172 bash[24902]: cluster 2023-12-07T17:29:46.568460+0000 mgr.smithi172.nqsqxd (mgr.14199) 899 : cluster 0 pgmap v770: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:49.425 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:49.425 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:29:50.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:49 smithi172 bash[24902]: cluster 2023-12-07T17:29:48.569104+0000 mgr.smithi172.nqsqxd (mgr.14199) 900 : cluster 0 pgmap v771: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:50.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:49 smithi172 bash[24902]: audit 2023-12-07T17:29:49.109173+0000 mon.smithi172 (mon.0) 679 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:29:50.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:49 smithi172 bash[24902]: audit 2023-12-07T17:29:49.412030+0000 mgr.smithi172.nqsqxd (mgr.14199) 901 : audit 0 from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:29:50.212 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:29:51.213 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:29:52.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:51 smithi172 bash[24902]: cluster 2023-12-07T17:29:50.569747+0000 mgr.smithi172.nqsqxd (mgr.14199) 902 : cluster 0 pgmap v772: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:54.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:53 smithi172 bash[24902]: cluster 2023-12-07T17:29:52.570593+0000 mgr.smithi172.nqsqxd (mgr.14199) 903 : cluster 0 pgmap v773: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:56.013 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:29:56.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:55 smithi172 bash[24902]: cluster 2023-12-07T17:29:54.571279+0000 mgr.smithi172.nqsqxd (mgr.14199) 904 : cluster 0 pgmap v774: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:58.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:57 smithi172 bash[24902]: cluster 2023-12-07T17:29:56.572056+0000 mgr.smithi172.nqsqxd (mgr.14199) 905 : cluster 0 pgmap v775: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:29:59.410 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:29:59.410 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:00.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:59 smithi172 bash[24902]: cluster 2023-12-07T17:29:58.572713+0000 mgr.smithi172.nqsqxd (mgr.14199) 906 : cluster 0 pgmap v776: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:00.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:29:59 smithi172 bash[24902]: audit 2023-12-07T17:29:59.398661+0000 mgr.smithi172.nqsqxd (mgr.14199) 907 : audit 0 from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:00.273 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:01.275 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:02.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:01 smithi172 bash[24902]: cluster 2023-12-07T17:30:00.573362+0000 mgr.smithi172.nqsqxd (mgr.14199) 908 : cluster 0 pgmap v777: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:04.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:03 smithi172 bash[24902]: cluster 2023-12-07T17:30:02.574128+0000 mgr.smithi172.nqsqxd (mgr.14199) 909 : cluster 0 pgmap v778: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:05.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:04 smithi172 bash[24902]: audit 2023-12-07T17:30:04.109586+0000 mon.smithi172 (mon.0) 680 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:30:06.073 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:06.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:05 smithi172 bash[24902]: cluster 2023-12-07T17:30:04.574867+0000 mgr.smithi172.nqsqxd (mgr.14199) 910 : cluster 0 pgmap v779: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:08.126 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:07 smithi172 bash[24902]: cluster 2023-12-07T17:30:06.575680+0000 mgr.smithi172.nqsqxd (mgr.14199) 911 : cluster 0 pgmap v780: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:09.459 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:09.459 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:10.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:09 smithi172 bash[24902]: cluster 2023-12-07T17:30:08.576350+0000 mgr.smithi172.nqsqxd (mgr.14199) 912 : cluster 0 pgmap v781: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:10.286 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:11.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:10 smithi172 bash[24902]: audit 2023-12-07T17:30:09.449045+0000 mgr.smithi172.nqsqxd (mgr.14199) 913 : audit 0 from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:11.287 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:12.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:11 smithi172 bash[24902]: cluster 2023-12-07T17:30:10.577011+0000 mgr.smithi172.nqsqxd (mgr.14199) 914 : cluster 0 pgmap v782: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:14.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:13 smithi172 bash[24902]: cluster 2023-12-07T17:30:12.577844+0000 mgr.smithi172.nqsqxd (mgr.14199) 915 : cluster 0 pgmap v783: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:16.082 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:16.218 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:15 smithi172 bash[24902]: cluster 2023-12-07T17:30:14.578604+0000 mgr.smithi172.nqsqxd (mgr.14199) 916 : cluster 0 pgmap v784: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:18.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:17 smithi172 bash[24902]: cluster 2023-12-07T17:30:16.579365+0000 mgr.smithi172.nqsqxd (mgr.14199) 917 : cluster 0 pgmap v785: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:19.260 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:19.260 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:20.048 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:19 smithi172 bash[24902]: cluster 2023-12-07T17:30:18.580043+0000 mgr.smithi172.nqsqxd (mgr.14199) 918 : cluster 0 pgmap v786: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:19 smithi172 bash[24902]: audit 2023-12-07T17:30:19.109822+0000 mon.smithi172 (mon.0) 681 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:30:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:19 smithi172 bash[24902]: audit 2023-12-07T17:30:19.247133+0000 mgr.smithi172.nqsqxd (mgr.14199) 919 : audit 0 from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:21.049 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:22.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:21 smithi172 bash[24902]: cluster 2023-12-07T17:30:20.580761+0000 mgr.smithi172.nqsqxd (mgr.14199) 920 : cluster 0 pgmap v787: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:24.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:23 smithi172 bash[24902]: cluster 2023-12-07T17:30:22.581418+0000 mgr.smithi172.nqsqxd (mgr.14199) 921 : cluster 0 pgmap v788: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:25.838 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:26.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:25 smithi172 bash[24902]: cluster 2023-12-07T17:30:24.582097+0000 mgr.smithi172.nqsqxd (mgr.14199) 922 : cluster 0 pgmap v789: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:28.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:27 smithi172 bash[24902]: cluster 2023-12-07T17:30:26.583027+0000 mgr.smithi172.nqsqxd (mgr.14199) 923 : cluster 0 pgmap v790: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:29.375 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:29.375 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:30.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:29 smithi172 bash[24902]: cluster 2023-12-07T17:30:28.583715+0000 mgr.smithi172.nqsqxd (mgr.14199) 924 : cluster 0 pgmap v791: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:30.157 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:29 smithi172 bash[24902]: audit 2023-12-07T17:30:29.363394+0000 mgr.smithi172.nqsqxd (mgr.14199) 925 : audit 0 from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:30.158 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:31.159 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:31 smithi172 bash[24902]: cluster 2023-12-07T17:30:30.584403+0000 mgr.smithi172.nqsqxd (mgr.14199) 926 : cluster 0 pgmap v792: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:33.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:32 smithi172 bash[24902]: audit 2023-12-07T17:30:32.621141+0000 mon.smithi172 (mon.0) 682 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:30:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:33 smithi172 bash[24902]: cluster 2023-12-07T17:30:32.585248+0000 mgr.smithi172.nqsqxd (mgr.14199) 927 : cluster 0 pgmap v793: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:33 smithi172 bash[24902]: audit 2023-12-07T17:30:33.195942+0000 mon.smithi172 (mon.0) 683 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:30:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:33 smithi172 bash[24902]: audit 2023-12-07T17:30:33.197582+0000 mon.smithi172 (mon.0) 684 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:30:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:33 smithi172 bash[24902]: cluster 2023-12-07T17:30:33.200072+0000 mgr.smithi172.nqsqxd (mgr.14199) 928 : cluster 0 pgmap v794: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:33 smithi172 bash[24902]: audit 2023-12-07T17:30:33.205236+0000 mon.smithi172 (mon.0) 685 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:30:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:34 smithi172 bash[24902]: audit 2023-12-07T17:30:34.110424+0000 mon.smithi172 (mon.0) 686 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:30:35.954 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:36.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:35 smithi172 bash[24902]: cluster 2023-12-07T17:30:35.200742+0000 mgr.smithi172.nqsqxd (mgr.14199) 929 : cluster 0 pgmap v795: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:38.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:37 smithi172 bash[24902]: cluster 2023-12-07T17:30:37.201410+0000 mgr.smithi172.nqsqxd (mgr.14199) 930 : cluster 0 pgmap v796: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:39.355 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:39.355 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:40.154 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:40.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:40 smithi172 bash[24902]: cluster 2023-12-07T17:30:39.201864+0000 mgr.smithi172.nqsqxd (mgr.14199) 931 : cluster 0 pgmap v797: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:40.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:40 smithi172 bash[24902]: audit 2023-12-07T17:30:39.342641+0000 mgr.smithi172.nqsqxd (mgr.14199) 932 : audit 0 from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:41.155 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:42.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:42 smithi172 bash[24902]: cluster 2023-12-07T17:30:41.202678+0000 mgr.smithi172.nqsqxd (mgr.14199) 933 : cluster 0 pgmap v798: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:44.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:44 smithi172 bash[24902]: cluster 2023-12-07T17:30:43.203428+0000 mgr.smithi172.nqsqxd (mgr.14199) 934 : cluster 0 pgmap v799: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:45.953 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:46.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:46 smithi172 bash[24902]: cluster 2023-12-07T17:30:45.204079+0000 mgr.smithi172.nqsqxd (mgr.14199) 935 : cluster 0 pgmap v800: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:48.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:47 smithi172 bash[24902]: cluster 2023-12-07T17:30:47.204739+0000 mgr.smithi172.nqsqxd (mgr.14199) 936 : cluster 0 pgmap v801: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:49.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:49 smithi172 bash[24902]: audit 2023-12-07T17:30:49.110824+0000 mon.smithi172 (mon.0) 687 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:30:49.597 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:49.597 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:30:50.478 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:50 smithi172 bash[24902]: cluster 2023-12-07T17:30:49.205251+0000 mgr.smithi172.nqsqxd (mgr.14199) 937 : cluster 0 pgmap v802: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:50.479 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:30:51.480 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:30:51.493 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:51 smithi172 bash[24902]: audit 2023-12-07T17:30:49.583983+0000 mgr.smithi172.nqsqxd (mgr.14199) 938 : audit 0 from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:30:52.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:52 smithi172 bash[24902]: cluster 2023-12-07T17:30:51.206125+0000 mgr.smithi172.nqsqxd (mgr.14199) 939 : cluster 0 pgmap v803: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:54.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:54 smithi172 bash[24902]: cluster 2023-12-07T17:30:53.207044+0000 mgr.smithi172.nqsqxd (mgr.14199) 940 : cluster 0 pgmap v804: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:56.278 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:30:56.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:56 smithi172 bash[24902]: cluster 2023-12-07T17:30:55.207732+0000 mgr.smithi172.nqsqxd (mgr.14199) 941 : cluster 0 pgmap v805: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:58.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:30:57 smithi172 bash[24902]: cluster 2023-12-07T17:30:57.208276+0000 mgr.smithi172.nqsqxd (mgr.14199) 942 : cluster 0 pgmap v806: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:30:59.605 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:30:59.605 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:00.431 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:00.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:00 smithi172 bash[24902]: cluster 2023-12-07T17:30:59.208908+0000 mgr.smithi172.nqsqxd (mgr.14199) 943 : cluster 0 pgmap v807: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:01.432 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:01.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:01 smithi172 bash[24902]: audit 2023-12-07T17:30:59.592653+0000 mgr.smithi172.nqsqxd (mgr.14199) 944 : audit 0 from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:02.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:02 smithi172 bash[24902]: cluster 2023-12-07T17:31:01.209671+0000 mgr.smithi172.nqsqxd (mgr.14199) 945 : cluster 0 pgmap v808: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:04 smithi172 bash[24902]: cluster 2023-12-07T17:31:03.210306+0000 mgr.smithi172.nqsqxd (mgr.14199) 946 : cluster 0 pgmap v809: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:04 smithi172 bash[24902]: audit 2023-12-07T17:31:04.111313+0000 mon.smithi172 (mon.0) 688 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:31:06.225 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:06.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:06 smithi172 bash[24902]: cluster 2023-12-07T17:31:05.210903+0000 mgr.smithi172.nqsqxd (mgr.14199) 947 : cluster 0 pgmap v810: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:08.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:07 smithi172 bash[24902]: cluster 2023-12-07T17:31:07.211404+0000 mgr.smithi172.nqsqxd (mgr.14199) 948 : cluster 0 pgmap v811: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:09.625 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:31:09.625 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:10.458 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:10.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:10 smithi172 bash[24902]: cluster 2023-12-07T17:31:09.211967+0000 mgr.smithi172.nqsqxd (mgr.14199) 949 : cluster 0 pgmap v812: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:11.459 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:11.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:11 smithi172 bash[24902]: audit 2023-12-07T17:31:09.613791+0000 mgr.smithi172.nqsqxd (mgr.14199) 950 : audit 0 from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:12.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:12 smithi172 bash[24902]: cluster 2023-12-07T17:31:11.212672+0000 mgr.smithi172.nqsqxd (mgr.14199) 951 : cluster 0 pgmap v813: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:14.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:14 smithi172 bash[24902]: cluster 2023-12-07T17:31:13.213431+0000 mgr.smithi172.nqsqxd (mgr.14199) 952 : cluster 0 pgmap v814: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:16.256 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:16.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:16 smithi172 bash[24902]: cluster 2023-12-07T17:31:15.214078+0000 mgr.smithi172.nqsqxd (mgr.14199) 953 : cluster 0 pgmap v815: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:18.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:17 smithi172 bash[24902]: cluster 2023-12-07T17:31:17.214937+0000 mgr.smithi172.nqsqxd (mgr.14199) 954 : cluster 0 pgmap v816: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:19.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:19 smithi172 bash[24902]: audit 2023-12-07T17:31:19.111186+0000 mon.smithi172 (mon.0) 689 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:31:19.692 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:31:19.692 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:20 smithi172 bash[24902]: cluster 2023-12-07T17:31:19.215592+0000 mgr.smithi172.nqsqxd (mgr.14199) 955 : cluster 0 pgmap v817: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:20.561 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:21.562 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:21.575 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:21 smithi172 bash[24902]: audit 2023-12-07T17:31:19.682147+0000 mgr.smithi172.nqsqxd (mgr.14199) 956 : audit 0 from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:22.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:22 smithi172 bash[24902]: cluster 2023-12-07T17:31:21.216338+0000 mgr.smithi172.nqsqxd (mgr.14199) 957 : cluster 0 pgmap v818: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:24.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:24 smithi172 bash[24902]: cluster 2023-12-07T17:31:23.217005+0000 mgr.smithi172.nqsqxd (mgr.14199) 958 : cluster 0 pgmap v819: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:26.354 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:26.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:26 smithi172 bash[24902]: cluster 2023-12-07T17:31:25.217653+0000 mgr.smithi172.nqsqxd (mgr.14199) 959 : cluster 0 pgmap v820: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:28.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:27 smithi172 bash[24902]: cluster 2023-12-07T17:31:27.218552+0000 mgr.smithi172.nqsqxd (mgr.14199) 960 : cluster 0 pgmap v821: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:29.908 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:31:29.908 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:30.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:30 smithi172 bash[24902]: cluster 2023-12-07T17:31:29.219048+0000 mgr.smithi172.nqsqxd (mgr.14199) 961 : cluster 0 pgmap v822: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:30.746 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:31.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:31 smithi172 bash[24902]: audit 2023-12-07T17:31:29.894775+0000 mgr.smithi172.nqsqxd (mgr.14199) 962 : audit 0 from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:31.747 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:32.607 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:32 smithi172 bash[24902]: cluster 2023-12-07T17:31:31.219795+0000 mgr.smithi172.nqsqxd (mgr.14199) 963 : cluster 0 pgmap v823: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:33.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:33 smithi172 bash[24902]: audit 2023-12-07T17:31:33.257072+0000 mon.smithi172 (mon.0) 690 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:31:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:34 smithi172 bash[24902]: cluster 2023-12-07T17:31:33.220514+0000 mgr.smithi172.nqsqxd (mgr.14199) 964 : cluster 0 pgmap v824: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:34 smithi172 bash[24902]: audit 2023-12-07T17:31:33.877498+0000 mon.smithi172 (mon.0) 691 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:31:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:34 smithi172 bash[24902]: audit 2023-12-07T17:31:33.879441+0000 mon.smithi172 (mon.0) 692 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:31:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:34 smithi172 bash[24902]: audit 2023-12-07T17:31:33.888230+0000 mon.smithi172 (mon.0) 693 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:31:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:34 smithi172 bash[24902]: audit 2023-12-07T17:31:34.111886+0000 mon.smithi172 (mon.0) 694 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:31:35.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:35 smithi172 bash[24902]: cluster 2023-12-07T17:31:33.882176+0000 mgr.smithi172.nqsqxd (mgr.14199) 965 : cluster 0 pgmap v825: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:35.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:35 smithi172 bash[24902]: cluster 2023-12-07T17:31:33.882704+0000 mgr.smithi172.nqsqxd (mgr.14199) 966 : cluster 0 pgmap v826: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:36.539 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:37.555 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:37 smithi172 bash[24902]: cluster 2023-12-07T17:31:35.883334+0000 mgr.smithi172.nqsqxd (mgr.14199) 967 : cluster 0 pgmap v827: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:39.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:39 smithi172 bash[24902]: cluster 2023-12-07T17:31:37.884152+0000 mgr.smithi172.nqsqxd (mgr.14199) 968 : cluster 0 pgmap v828: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:39.920 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:31:39.921 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:40.721 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:41.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:41 smithi172 bash[24902]: cluster 2023-12-07T17:31:39.884771+0000 mgr.smithi172.nqsqxd (mgr.14199) 969 : cluster 0 pgmap v829: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:41.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:41 smithi172 bash[24902]: audit 2023-12-07T17:31:39.909079+0000 mgr.smithi172.nqsqxd (mgr.14199) 970 : audit 0 from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:41.721 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:43.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:42 smithi172 bash[24902]: cluster 2023-12-07T17:31:41.885345+0000 mgr.smithi172.nqsqxd (mgr.14199) 971 : cluster 0 pgmap v830: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:45.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:44 smithi172 bash[24902]: cluster 2023-12-07T17:31:43.885974+0000 mgr.smithi172.nqsqxd (mgr.14199) 972 : cluster 0 pgmap v831: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:46.515 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:47.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:46 smithi172 bash[24902]: cluster 2023-12-07T17:31:45.886667+0000 mgr.smithi172.nqsqxd (mgr.14199) 973 : cluster 0 pgmap v832: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:49.364 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:48 smithi172 bash[24902]: cluster 2023-12-07T17:31:47.887199+0000 mgr.smithi172.nqsqxd (mgr.14199) 974 : cluster 0 pgmap v833: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:49.840 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:31:49.841 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:31:50.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:49 smithi172 bash[24902]: audit 2023-12-07T17:31:49.112539+0000 mon.smithi172 (mon.0) 695 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:31:50.720 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:31:51.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:50 smithi172 bash[24902]: audit 2023-12-07T17:31:49.833117+0000 mgr.smithi172.nqsqxd (mgr.14199) 975 : audit 0 from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:31:51.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:50 smithi172 bash[24902]: cluster 2023-12-07T17:31:49.887749+0000 mgr.smithi172.nqsqxd (mgr.14199) 976 : cluster 0 pgmap v834: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:51.721 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:31:53.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:52 smithi172 bash[24902]: cluster 2023-12-07T17:31:51.888531+0000 mgr.smithi172.nqsqxd (mgr.14199) 977 : cluster 0 pgmap v835: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:55.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:54 smithi172 bash[24902]: cluster 2023-12-07T17:31:53.889261+0000 mgr.smithi172.nqsqxd (mgr.14199) 978 : cluster 0 pgmap v836: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:56.510 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:31:57.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:56 smithi172 bash[24902]: cluster 2023-12-07T17:31:55.890017+0000 mgr.smithi172.nqsqxd (mgr.14199) 979 : cluster 0 pgmap v837: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:31:59.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:31:58 smithi172 bash[24902]: cluster 2023-12-07T17:31:57.890903+0000 mgr.smithi172.nqsqxd (mgr.14199) 980 : cluster 0 pgmap v838: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:00.085 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:00.085 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:00.867 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:01.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:00 smithi172 bash[24902]: cluster 2023-12-07T17:31:59.891462+0000 mgr.smithi172.nqsqxd (mgr.14199) 981 : cluster 0 pgmap v839: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:01.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:00 smithi172 bash[24902]: audit 2023-12-07T17:32:00.078268+0000 mgr.smithi172.nqsqxd (mgr.14199) 982 : audit 0 from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:01.868 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:03.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:02 smithi172 bash[24902]: cluster 2023-12-07T17:32:01.892194+0000 mgr.smithi172.nqsqxd (mgr.14199) 983 : cluster 0 pgmap v840: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:04 smithi172 bash[24902]: cluster 2023-12-07T17:32:03.892912+0000 mgr.smithi172.nqsqxd (mgr.14199) 984 : cluster 0 pgmap v841: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:04 smithi172 bash[24902]: audit 2023-12-07T17:32:04.112264+0000 mon.smithi172 (mon.0) 696 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:32:06.657 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:07.277 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:06 smithi172 bash[24902]: cluster 2023-12-07T17:32:05.893599+0000 mgr.smithi172.nqsqxd (mgr.14199) 985 : cluster 0 pgmap v842: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:09.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:08 smithi172 bash[24902]: cluster 2023-12-07T17:32:07.894445+0000 mgr.smithi172.nqsqxd (mgr.14199) 986 : cluster 0 pgmap v843: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:10.273 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:10.273 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:11.136 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:11.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:10 smithi172 bash[24902]: cluster 2023-12-07T17:32:09.895095+0000 mgr.smithi172.nqsqxd (mgr.14199) 987 : cluster 0 pgmap v844: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:11.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:10 smithi172 bash[24902]: audit 2023-12-07T17:32:10.261074+0000 mgr.smithi172.nqsqxd (mgr.14199) 988 : audit 0 from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:12.137 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:13.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:12 smithi172 bash[24902]: cluster 2023-12-07T17:32:11.895941+0000 mgr.smithi172.nqsqxd (mgr.14199) 989 : cluster 0 pgmap v845: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:15.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:14 smithi172 bash[24902]: cluster 2023-12-07T17:32:13.896722+0000 mgr.smithi172.nqsqxd (mgr.14199) 990 : cluster 0 pgmap v846: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:16.933 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:17.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:16 smithi172 bash[24902]: cluster 2023-12-07T17:32:15.897450+0000 mgr.smithi172.nqsqxd (mgr.14199) 991 : cluster 0 pgmap v847: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:19.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:18 smithi172 bash[24902]: cluster 2023-12-07T17:32:17.898271+0000 mgr.smithi172.nqsqxd (mgr.14199) 992 : cluster 0 pgmap v848: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:19 smithi172 bash[24902]: audit 2023-12-07T17:32:19.113116+0000 mon.smithi172 (mon.0) 697 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:32:20.564 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:20.564 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:21.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:20 smithi172 bash[24902]: cluster 2023-12-07T17:32:19.898940+0000 mgr.smithi172.nqsqxd (mgr.14199) 993 : cluster 0 pgmap v849: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:21.425 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:22.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:21 smithi172 bash[24902]: audit 2023-12-07T17:32:20.551992+0000 mgr.smithi172.nqsqxd (mgr.14199) 994 : audit 0 from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:22.425 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:23.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:22 smithi172 bash[24902]: cluster 2023-12-07T17:32:21.899805+0000 mgr.smithi172.nqsqxd (mgr.14199) 995 : cluster 0 pgmap v850: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:25.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:24 smithi172 bash[24902]: cluster 2023-12-07T17:32:23.900486+0000 mgr.smithi172.nqsqxd (mgr.14199) 996 : cluster 0 pgmap v851: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:27.219 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:27.250 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:26 smithi172 bash[24902]: cluster 2023-12-07T17:32:25.901244+0000 mgr.smithi172.nqsqxd (mgr.14199) 997 : cluster 0 pgmap v852: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:29.322 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:28 smithi172 bash[24902]: cluster 2023-12-07T17:32:27.902029+0000 mgr.smithi172.nqsqxd (mgr.14199) 998 : cluster 0 pgmap v853: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:30.708 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:30.708 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:31.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:30 smithi172 bash[24902]: cluster 2023-12-07T17:32:29.902475+0000 mgr.smithi172.nqsqxd (mgr.14199) 999 : cluster 0 pgmap v854: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:31.543 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:31 smithi172 bash[24902]: audit 2023-12-07T17:32:30.700779+0000 mgr.smithi172.nqsqxd (mgr.14199) 1000 : audit 0 from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:32.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:33.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:32 smithi172 bash[24902]: cluster 2023-12-07T17:32:31.903199+0000 mgr.smithi172.nqsqxd (mgr.14199) 1001 : cluster 0 pgmap v855: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:33 smithi172 bash[24902]: audit 2023-12-07T17:32:33.938949+0000 mon.smithi172 (mon.0) 698 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:32:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:34 smithi172 bash[24902]: cluster 2023-12-07T17:32:33.903853+0000 mgr.smithi172.nqsqxd (mgr.14199) 1002 : cluster 0 pgmap v856: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:34 smithi172 bash[24902]: audit 2023-12-07T17:32:34.112974+0000 mon.smithi172 (mon.0) 699 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:32:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:34 smithi172 bash[24902]: audit 2023-12-07T17:32:34.561092+0000 mon.smithi172 (mon.0) 700 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:32:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:34 smithi172 bash[24902]: audit 2023-12-07T17:32:34.562444+0000 mon.smithi172 (mon.0) 701 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:32:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:34 smithi172 bash[24902]: audit 2023-12-07T17:32:34.570573+0000 mon.smithi172 (mon.0) 702 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:32:36.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:35 smithi172 bash[24902]: cluster 2023-12-07T17:32:34.564795+0000 mgr.smithi172.nqsqxd (mgr.14199) 1003 : cluster 0 pgmap v857: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:36.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:35 smithi172 bash[24902]: cluster 2023-12-07T17:32:34.565222+0000 mgr.smithi172.nqsqxd (mgr.14199) 1004 : cluster 0 pgmap v858: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:37.335 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:38.287 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:37 smithi172 bash[24902]: cluster 2023-12-07T17:32:36.565773+0000 mgr.smithi172.nqsqxd (mgr.14199) 1005 : cluster 0 pgmap v859: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:40.311 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:39 smithi172 bash[24902]: cluster 2023-12-07T17:32:38.566399+0000 mgr.smithi172.nqsqxd (mgr.14199) 1006 : cluster 0 pgmap v860: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:40.776 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:40.776 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:41.627 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:42.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:41 smithi172 bash[24902]: cluster 2023-12-07T17:32:40.566994+0000 mgr.smithi172.nqsqxd (mgr.14199) 1007 : cluster 0 pgmap v861: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:42.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:41 smithi172 bash[24902]: audit 2023-12-07T17:32:40.765362+0000 mgr.smithi172.nqsqxd (mgr.14199) 1008 : audit 0 from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:42.628 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:44.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:43 smithi172 bash[24902]: cluster 2023-12-07T17:32:42.567855+0000 mgr.smithi172.nqsqxd (mgr.14199) 1009 : cluster 0 pgmap v862: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:46.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:45 smithi172 bash[24902]: cluster 2023-12-07T17:32:44.568497+0000 mgr.smithi172.nqsqxd (mgr.14199) 1010 : cluster 0 pgmap v863: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:47.428 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:48.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:47 smithi172 bash[24902]: cluster 2023-12-07T17:32:46.569293+0000 mgr.smithi172.nqsqxd (mgr.14199) 1011 : cluster 0 pgmap v864: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:49 smithi172 bash[24902]: cluster 2023-12-07T17:32:48.569998+0000 mgr.smithi172.nqsqxd (mgr.14199) 1012 : cluster 0 pgmap v865: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:50.375 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:49 smithi172 bash[24902]: audit 2023-12-07T17:32:49.114080+0000 mon.smithi172 (mon.0) 703 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:32:50.862 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:32:50.862 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:32:51.719 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:32:52.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:52 smithi172 bash[24902]: cluster 2023-12-07T17:32:50.570422+0000 mgr.smithi172.nqsqxd (mgr.14199) 1013 : cluster 0 pgmap v866: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:52.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:52 smithi172 bash[24902]: audit 2023-12-07T17:32:50.851510+0000 mgr.smithi172.nqsqxd (mgr.14199) 1014 : audit 0 from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:32:52.720 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:32:54.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:54 smithi172 bash[24902]: cluster 2023-12-07T17:32:52.571305+0000 mgr.smithi172.nqsqxd (mgr.14199) 1015 : cluster 0 pgmap v867: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:56.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:56 smithi172 bash[24902]: cluster 2023-12-07T17:32:54.572133+0000 mgr.smithi172.nqsqxd (mgr.14199) 1016 : cluster 0 pgmap v868: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:32:57.515 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:32:58.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:32:58 smithi172 bash[24902]: cluster 2023-12-07T17:32:56.572977+0000 mgr.smithi172.nqsqxd (mgr.14199) 1017 : cluster 0 pgmap v869: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:00.358 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:00 smithi172 bash[24902]: cluster 2023-12-07T17:32:58.573596+0000 mgr.smithi172.nqsqxd (mgr.14199) 1018 : cluster 0 pgmap v870: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:00.830 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:00.831 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:01.647 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:02.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:02 smithi172 bash[24902]: cluster 2023-12-07T17:33:00.574231+0000 mgr.smithi172.nqsqxd (mgr.14199) 1019 : cluster 0 pgmap v871: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:02.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:02 smithi172 bash[24902]: audit 2023-12-07T17:33:00.818386+0000 mgr.smithi172.nqsqxd (mgr.14199) 1020 : audit 0 from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:02.647 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:04.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:04 smithi172 bash[24902]: cluster 2023-12-07T17:33:02.575110+0000 mgr.smithi172.nqsqxd (mgr.14199) 1021 : cluster 0 pgmap v872: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:05 smithi172 bash[24902]: audit 2023-12-07T17:33:04.114509+0000 mon.smithi172 (mon.0) 704 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:33:06.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:06 smithi172 bash[24902]: cluster 2023-12-07T17:33:04.575815+0000 mgr.smithi172.nqsqxd (mgr.14199) 1022 : cluster 0 pgmap v873: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:07.450 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:08.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:08 smithi172 bash[24902]: cluster 2023-12-07T17:33:06.576645+0000 mgr.smithi172.nqsqxd (mgr.14199) 1023 : cluster 0 pgmap v874: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:10.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:10 smithi172 bash[24902]: cluster 2023-12-07T17:33:08.577287+0000 mgr.smithi172.nqsqxd (mgr.14199) 1024 : cluster 0 pgmap v875: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:10.865 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:10.865 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:11.704 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:12.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:12 smithi172 bash[24902]: cluster 2023-12-07T17:33:10.577929+0000 mgr.smithi172.nqsqxd (mgr.14199) 1025 : cluster 0 pgmap v876: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:12.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:12 smithi172 bash[24902]: audit 2023-12-07T17:33:10.852217+0000 mgr.smithi172.nqsqxd (mgr.14199) 1026 : audit 0 from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:12.705 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:14.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:14 smithi172 bash[24902]: cluster 2023-12-07T17:33:12.578849+0000 mgr.smithi172.nqsqxd (mgr.14199) 1027 : cluster 0 pgmap v877: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:16.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:16 smithi172 bash[24902]: cluster 2023-12-07T17:33:14.579623+0000 mgr.smithi172.nqsqxd (mgr.14199) 1028 : cluster 0 pgmap v878: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:17.497 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:18.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:18 smithi172 bash[24902]: cluster 2023-12-07T17:33:16.580576+0000 mgr.smithi172.nqsqxd (mgr.14199) 1029 : cluster 0 pgmap v879: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:20 smithi172 bash[24902]: cluster 2023-12-07T17:33:18.581238+0000 mgr.smithi172.nqsqxd (mgr.14199) 1030 : cluster 0 pgmap v880: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:20.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:20 smithi172 bash[24902]: audit 2023-12-07T17:33:19.114560+0000 mon.smithi172 (mon.0) 705 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:33:20.834 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:20.834 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:21.637 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:22.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:22 smithi172 bash[24902]: cluster 2023-12-07T17:33:20.581948+0000 mgr.smithi172.nqsqxd (mgr.14199) 1031 : cluster 0 pgmap v881: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:22.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:22 smithi172 bash[24902]: audit 2023-12-07T17:33:20.822084+0000 mgr.smithi172.nqsqxd (mgr.14199) 1032 : audit 0 from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:22.637 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:24.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:24 smithi172 bash[24902]: cluster 2023-12-07T17:33:22.582741+0000 mgr.smithi172.nqsqxd (mgr.14199) 1033 : cluster 0 pgmap v882: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:26.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:26 smithi172 bash[24902]: cluster 2023-12-07T17:33:24.583355+0000 mgr.smithi172.nqsqxd (mgr.14199) 1034 : cluster 0 pgmap v883: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:27.432 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:28.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:28 smithi172 bash[24902]: cluster 2023-12-07T17:33:26.584251+0000 mgr.smithi172.nqsqxd (mgr.14199) 1035 : cluster 0 pgmap v884: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:30.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:30 smithi172 bash[24902]: cluster 2023-12-07T17:33:28.584870+0000 mgr.smithi172.nqsqxd (mgr.14199) 1036 : cluster 0 pgmap v885: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:30.731 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:30.731 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:31.582 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:32 smithi172 bash[24902]: cluster 2023-12-07T17:33:30.585491+0000 mgr.smithi172.nqsqxd (mgr.14199) 1037 : cluster 0 pgmap v886: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:32.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:32 smithi172 bash[24902]: audit 2023-12-07T17:33:30.719032+0000 mgr.smithi172.nqsqxd (mgr.14199) 1038 : audit 0 from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:32.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:34.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:34 smithi172 bash[24902]: cluster 2023-12-07T17:33:32.586296+0000 mgr.smithi172.nqsqxd (mgr.14199) 1039 : cluster 0 pgmap v887: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:35 smithi172 bash[24902]: audit 2023-12-07T17:33:34.115057+0000 mon.smithi172 (mon.0) 706 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:33:35.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:35 smithi172 bash[24902]: audit 2023-12-07T17:33:34.621410+0000 mon.smithi172 (mon.0) 707 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:33:36.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: cluster 2023-12-07T17:33:34.586961+0000 mgr.smithi172.nqsqxd (mgr.14199) 1040 : cluster 0 pgmap v888: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: audit 2023-12-07T17:33:35.244317+0000 mon.smithi172 (mon.0) 708 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:33:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: audit 2023-12-07T17:33:35.245978+0000 mon.smithi172 (mon.0) 709 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:33:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: cluster 2023-12-07T17:33:35.248485+0000 mgr.smithi172.nqsqxd (mgr.14199) 1041 : cluster 0 pgmap v889: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: cluster 2023-12-07T17:33:35.249019+0000 mgr.smithi172.nqsqxd (mgr.14199) 1042 : cluster 0 pgmap v890: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:36 smithi172 bash[24902]: audit 2023-12-07T17:33:35.254450+0000 mon.smithi172 (mon.0) 710 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:33:37.370 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:38.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:37 smithi172 bash[24902]: cluster 2023-12-07T17:33:37.249750+0000 mgr.smithi172.nqsqxd (mgr.14199) 1043 : cluster 0 pgmap v891: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:40.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:40 smithi172 bash[24902]: cluster 2023-12-07T17:33:39.250383+0000 mgr.smithi172.nqsqxd (mgr.14199) 1044 : cluster 0 pgmap v892: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:40.664 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:40.664 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:41.536 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:42.538 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:42.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:42 smithi172 bash[24902]: audit 2023-12-07T17:33:40.653385+0000 mgr.smithi172.nqsqxd (mgr.14199) 1045 : audit 0 from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:42.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:42 smithi172 bash[24902]: cluster 2023-12-07T17:33:41.251076+0000 mgr.smithi172.nqsqxd (mgr.14199) 1046 : cluster 0 pgmap v893: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:44.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:44 smithi172 bash[24902]: cluster 2023-12-07T17:33:43.251915+0000 mgr.smithi172.nqsqxd (mgr.14199) 1047 : cluster 0 pgmap v894: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:46.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:46 smithi172 bash[24902]: cluster 2023-12-07T17:33:45.252585+0000 mgr.smithi172.nqsqxd (mgr.14199) 1048 : cluster 0 pgmap v895: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:47.331 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:48.349 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:47 smithi172 bash[24902]: cluster 2023-12-07T17:33:47.253377+0000 mgr.smithi172.nqsqxd (mgr.14199) 1049 : cluster 0 pgmap v896: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:49.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:49 smithi172 bash[24902]: audit 2023-12-07T17:33:49.115075+0000 mon.smithi172 (mon.0) 711 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:33:50.300 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:50 smithi172 bash[24902]: cluster 2023-12-07T17:33:49.253986+0000 mgr.smithi172.nqsqxd (mgr.14199) 1050 : cluster 0 pgmap v897: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:50.778 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:33:50.778 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:33:51.583 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:33:52.585 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:33:52.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:52 smithi172 bash[24902]: audit 2023-12-07T17:33:50.766701+0000 mgr.smithi172.nqsqxd (mgr.14199) 1051 : audit 0 from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:33:52.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:52 smithi172 bash[24902]: cluster 2023-12-07T17:33:51.254602+0000 mgr.smithi172.nqsqxd (mgr.14199) 1052 : cluster 0 pgmap v898: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:54.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:54 smithi172 bash[24902]: cluster 2023-12-07T17:33:53.255211+0000 mgr.smithi172.nqsqxd (mgr.14199) 1053 : cluster 0 pgmap v899: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:56.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:56 smithi172 bash[24902]: cluster 2023-12-07T17:33:55.255888+0000 mgr.smithi172.nqsqxd (mgr.14199) 1054 : cluster 0 pgmap v900: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:33:57.384 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:33:58.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:33:57 smithi172 bash[24902]: cluster 2023-12-07T17:33:57.256689+0000 mgr.smithi172.nqsqxd (mgr.14199) 1055 : cluster 0 pgmap v901: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:00.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:00 smithi172 bash[24902]: cluster 2023-12-07T17:33:59.257221+0000 mgr.smithi172.nqsqxd (mgr.14199) 1056 : cluster 0 pgmap v902: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:00.741 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:00.741 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:01.582 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:02.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:02.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:02 smithi172 bash[24902]: audit 2023-12-07T17:34:00.728202+0000 mgr.smithi172.nqsqxd (mgr.14199) 1057 : audit 0 from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:02.595 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:02 smithi172 bash[24902]: cluster 2023-12-07T17:34:01.257969+0000 mgr.smithi172.nqsqxd (mgr.14199) 1058 : cluster 0 pgmap v903: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:04 smithi172 bash[24902]: cluster 2023-12-07T17:34:03.258702+0000 mgr.smithi172.nqsqxd (mgr.14199) 1059 : cluster 0 pgmap v904: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:04 smithi172 bash[24902]: audit 2023-12-07T17:34:04.116114+0000 mon.smithi172 (mon.0) 712 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:34:06.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:06 smithi172 bash[24902]: cluster 2023-12-07T17:34:05.259255+0000 mgr.smithi172.nqsqxd (mgr.14199) 1060 : cluster 0 pgmap v905: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:07.378 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:08.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:07 smithi172 bash[24902]: cluster 2023-12-07T17:34:07.260060+0000 mgr.smithi172.nqsqxd (mgr.14199) 1061 : cluster 0 pgmap v906: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:10.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:10 smithi172 bash[24902]: cluster 2023-12-07T17:34:09.260420+0000 mgr.smithi172.nqsqxd (mgr.14199) 1062 : cluster 0 pgmap v907: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:10.746 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:10.746 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:11.590 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:12.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:12.602 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:12 smithi172 bash[24902]: audit 2023-12-07T17:34:10.735343+0000 mgr.smithi172.nqsqxd (mgr.14199) 1063 : audit 0 from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:12.603 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:12 smithi172 bash[24902]: cluster 2023-12-07T17:34:11.260989+0000 mgr.smithi172.nqsqxd (mgr.14199) 1064 : cluster 0 pgmap v908: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:14.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:14 smithi172 bash[24902]: cluster 2023-12-07T17:34:13.261706+0000 mgr.smithi172.nqsqxd (mgr.14199) 1065 : cluster 0 pgmap v909: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:16.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:16 smithi172 bash[24902]: cluster 2023-12-07T17:34:15.262392+0000 mgr.smithi172.nqsqxd (mgr.14199) 1066 : cluster 0 pgmap v910: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:17.387 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:18.319 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:17 smithi172 bash[24902]: cluster 2023-12-07T17:34:17.263106+0000 mgr.smithi172.nqsqxd (mgr.14199) 1067 : cluster 0 pgmap v911: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:19.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:19 smithi172 bash[24902]: audit 2023-12-07T17:34:19.116425+0000 mon.smithi172 (mon.0) 713 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:34:20.525 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:20 smithi172 bash[24902]: cluster 2023-12-07T17:34:19.263572+0000 mgr.smithi172.nqsqxd (mgr.14199) 1068 : cluster 0 pgmap v912: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:20.730 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:20.730 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:21.533 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:22.534 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:22.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:22 smithi172 bash[24902]: audit 2023-12-07T17:34:20.719105+0000 mgr.smithi172.nqsqxd (mgr.14199) 1069 : audit 0 from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:22.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:22 smithi172 bash[24902]: cluster 2023-12-07T17:34:21.264392+0000 mgr.smithi172.nqsqxd (mgr.14199) 1070 : cluster 0 pgmap v913: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:24.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:24 smithi172 bash[24902]: cluster 2023-12-07T17:34:23.265220+0000 mgr.smithi172.nqsqxd (mgr.14199) 1071 : cluster 0 pgmap v914: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:26.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:26 smithi172 bash[24902]: cluster 2023-12-07T17:34:25.265915+0000 mgr.smithi172.nqsqxd (mgr.14199) 1072 : cluster 0 pgmap v915: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:27.334 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:28.284 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:27 smithi172 bash[24902]: cluster 2023-12-07T17:34:27.266860+0000 mgr.smithi172.nqsqxd (mgr.14199) 1073 : cluster 0 pgmap v916: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:30.525 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:30.525 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:30.579 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:30 smithi172 bash[24902]: cluster 2023-12-07T17:34:29.267308+0000 mgr.smithi172.nqsqxd (mgr.14199) 1074 : cluster 0 pgmap v917: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:31.345 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:32.346 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:32 smithi172 bash[24902]: audit 2023-12-07T17:34:30.512240+0000 mgr.smithi172.nqsqxd (mgr.14199) 1075 : audit 0 from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:32.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:32 smithi172 bash[24902]: cluster 2023-12-07T17:34:31.267969+0000 mgr.smithi172.nqsqxd (mgr.14199) 1076 : cluster 0 pgmap v918: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:34 smithi172 bash[24902]: cluster 2023-12-07T17:34:33.268715+0000 mgr.smithi172.nqsqxd (mgr.14199) 1077 : cluster 0 pgmap v919: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:34 smithi172 bash[24902]: audit 2023-12-07T17:34:34.116749+0000 mon.smithi172 (mon.0) 714 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:34:35.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:35 smithi172 bash[24902]: audit 2023-12-07T17:34:35.305796+0000 mon.smithi172 (mon.0) 715 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:34:36.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:36 smithi172 bash[24902]: cluster 2023-12-07T17:34:35.269348+0000 mgr.smithi172.nqsqxd (mgr.14199) 1078 : cluster 0 pgmap v920: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:36.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:36 smithi172 bash[24902]: audit 2023-12-07T17:34:35.832677+0000 mon.smithi172 (mon.0) 716 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:34:36.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:36 smithi172 bash[24902]: audit 2023-12-07T17:34:35.841009+0000 mon.smithi172 (mon.0) 717 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:34:37.143 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:37.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:37 smithi172 bash[24902]: audit 2023-12-07T17:34:36.468085+0000 mon.smithi172 (mon.0) 718 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:34:37.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:37 smithi172 bash[24902]: audit 2023-12-07T17:34:36.469977+0000 mon.smithi172 (mon.0) 719 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:34:37.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:37 smithi172 bash[24902]: cluster 2023-12-07T17:34:36.472935+0000 mgr.smithi172.nqsqxd (mgr.14199) 1079 : cluster 0 pgmap v921: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:37.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:37 smithi172 bash[24902]: audit 2023-12-07T17:34:36.477386+0000 mon.smithi172 (mon.0) 720 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:34:38.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:38 smithi172 bash[24902]: cluster 2023-12-07T17:34:38.473508+0000 mgr.smithi172.nqsqxd (mgr.14199) 1080 : cluster 0 pgmap v922: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:40.590 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:40.590 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:40.813 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:40 smithi172 bash[24902]: cluster 2023-12-07T17:34:40.474086+0000 mgr.smithi172.nqsqxd (mgr.14199) 1081 : cluster 0 pgmap v923: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:41.486 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:41.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:41 smithi172 bash[24902]: audit 2023-12-07T17:34:40.577205+0000 mgr.smithi172.nqsqxd (mgr.14199) 1082 : audit 0 from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:42.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:43.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:42 smithi172 bash[24902]: cluster 2023-12-07T17:34:42.474979+0000 mgr.smithi172.nqsqxd (mgr.14199) 1083 : cluster 0 pgmap v924: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:44.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:44 smithi172 bash[24902]: cluster 2023-12-07T17:34:44.475662+0000 mgr.smithi172.nqsqxd (mgr.14199) 1084 : cluster 0 pgmap v925: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:46.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:46 smithi172 bash[24902]: cluster 2023-12-07T17:34:46.476304+0000 mgr.smithi172.nqsqxd (mgr.14199) 1085 : cluster 0 pgmap v926: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:47.284 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:48.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:48 smithi172 bash[24902]: cluster 2023-12-07T17:34:48.476854+0000 mgr.smithi172.nqsqxd (mgr.14199) 1086 : cluster 0 pgmap v927: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:49.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:49 smithi172 bash[24902]: audit 2023-12-07T17:34:49.116701+0000 mon.smithi172 (mon.0) 721 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:34:50.421 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:34:50.422 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:34:50.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:50 smithi172 bash[24902]: audit 2023-12-07T17:34:50.410012+0000 mgr.smithi172.nqsqxd (mgr.14199) 1087 : audit 0 from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:34:50.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:50 smithi172 bash[24902]: cluster 2023-12-07T17:34:50.477515+0000 mgr.smithi172.nqsqxd (mgr.14199) 1088 : cluster 0 pgmap v928: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:51.242 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:34:52.243 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:34:53.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:52 smithi172 bash[24902]: cluster 2023-12-07T17:34:52.478348+0000 mgr.smithi172.nqsqxd (mgr.14199) 1089 : cluster 0 pgmap v929: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:54.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:54 smithi172 bash[24902]: cluster 2023-12-07T17:34:54.479096+0000 mgr.smithi172.nqsqxd (mgr.14199) 1090 : cluster 0 pgmap v930: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:56.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:56 smithi172 bash[24902]: cluster 2023-12-07T17:34:56.479914+0000 mgr.smithi172.nqsqxd (mgr.14199) 1091 : cluster 0 pgmap v931: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:34:57.047 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:34:58.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:34:58 smithi172 bash[24902]: cluster 2023-12-07T17:34:58.480562+0000 mgr.smithi172.nqsqxd (mgr.14199) 1092 : cluster 0 pgmap v932: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:00.420 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:00.420 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:00.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:00 smithi172 bash[24902]: audit 2023-12-07T17:35:00.412920+0000 mgr.smithi172.nqsqxd (mgr.14199) 1093 : audit 0 from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:00.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:00 smithi172 bash[24902]: cluster 2023-12-07T17:35:00.481228+0000 mgr.smithi172.nqsqxd (mgr.14199) 1094 : cluster 0 pgmap v933: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:01.206 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:02.208 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:03.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:02 smithi172 bash[24902]: cluster 2023-12-07T17:35:02.482075+0000 mgr.smithi172.nqsqxd (mgr.14199) 1095 : cluster 0 pgmap v934: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:04.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:04 smithi172 bash[24902]: audit 2023-12-07T17:35:04.117479+0000 mon.smithi172 (mon.0) 722 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:35:05.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:05 smithi172 bash[24902]: cluster 2023-12-07T17:35:04.482774+0000 mgr.smithi172.nqsqxd (mgr.14199) 1096 : cluster 0 pgmap v935: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:06.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:06 smithi172 bash[24902]: cluster 2023-12-07T17:35:06.483713+0000 mgr.smithi172.nqsqxd (mgr.14199) 1097 : cluster 0 pgmap v936: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:07.006 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:08.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:08 smithi172 bash[24902]: cluster 2023-12-07T17:35:08.484330+0000 mgr.smithi172.nqsqxd (mgr.14199) 1098 : cluster 0 pgmap v937: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:10.433 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:10.433 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:10.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:10 smithi172 bash[24902]: audit 2023-12-07T17:35:10.422110+0000 mgr.smithi172.nqsqxd (mgr.14199) 1099 : audit 0 from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:10.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:10 smithi172 bash[24902]: cluster 2023-12-07T17:35:10.485012+0000 mgr.smithi172.nqsqxd (mgr.14199) 1100 : cluster 0 pgmap v938: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:11.250 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:12.252 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:13.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:12 smithi172 bash[24902]: cluster 2023-12-07T17:35:12.486096+0000 mgr.smithi172.nqsqxd (mgr.14199) 1101 : cluster 0 pgmap v939: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:14.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:14 smithi172 bash[24902]: cluster 2023-12-07T17:35:14.486913+0000 mgr.smithi172.nqsqxd (mgr.14199) 1102 : cluster 0 pgmap v940: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:16.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:16 smithi172 bash[24902]: cluster 2023-12-07T17:35:16.487745+0000 mgr.smithi172.nqsqxd (mgr.14199) 1103 : cluster 0 pgmap v941: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:17.059 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:18.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:18 smithi172 bash[24902]: cluster 2023-12-07T17:35:18.488262+0000 mgr.smithi172.nqsqxd (mgr.14199) 1104 : cluster 0 pgmap v942: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:19.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:19 smithi172 bash[24902]: audit 2023-12-07T17:35:19.117389+0000 mon.smithi172 (mon.0) 723 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:35:20.528 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:20.529 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:20.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:20 smithi172 bash[24902]: cluster 2023-12-07T17:35:20.488854+0000 mgr.smithi172.nqsqxd (mgr.14199) 1105 : cluster 0 pgmap v943: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:21.316 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:21.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:21 smithi172 bash[24902]: audit 2023-12-07T17:35:20.517215+0000 mgr.smithi172.nqsqxd (mgr.14199) 1106 : audit 0 from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:22.317 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:23.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:22 smithi172 bash[24902]: cluster 2023-12-07T17:35:22.489631+0000 mgr.smithi172.nqsqxd (mgr.14199) 1107 : cluster 0 pgmap v944: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:24.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:24 smithi172 bash[24902]: cluster 2023-12-07T17:35:24.490301+0000 mgr.smithi172.nqsqxd (mgr.14199) 1108 : cluster 0 pgmap v945: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:26.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:26 smithi172 bash[24902]: cluster 2023-12-07T17:35:26.491148+0000 mgr.smithi172.nqsqxd (mgr.14199) 1109 : cluster 0 pgmap v946: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:27.112 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:28.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:28 smithi172 bash[24902]: cluster 2023-12-07T17:35:28.491763+0000 mgr.smithi172.nqsqxd (mgr.14199) 1110 : cluster 0 pgmap v947: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:30.489 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:30.489 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:30.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:30 smithi172 bash[24902]: audit 2023-12-07T17:35:30.476056+0000 mgr.smithi172.nqsqxd (mgr.14199) 1111 : audit 0 from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:30.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:30 smithi172 bash[24902]: cluster 2023-12-07T17:35:30.492306+0000 mgr.smithi172.nqsqxd (mgr.14199) 1112 : cluster 0 pgmap v948: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:31.334 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:32.335 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:33.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:32 smithi172 bash[24902]: cluster 2023-12-07T17:35:32.493095+0000 mgr.smithi172.nqsqxd (mgr.14199) 1113 : cluster 0 pgmap v949: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:34.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:34 smithi172 bash[24902]: audit 2023-12-07T17:35:34.118318+0000 mon.smithi172 (mon.0) 724 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:35:35.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:35 smithi172 bash[24902]: cluster 2023-12-07T17:35:34.493661+0000 mgr.smithi172.nqsqxd (mgr.14199) 1114 : cluster 0 pgmap v950: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:36.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:36 smithi172 bash[24902]: cluster 2023-12-07T17:35:36.494540+0000 mgr.smithi172.nqsqxd (mgr.14199) 1115 : cluster 0 pgmap v951: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:36.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:36 smithi172 bash[24902]: audit 2023-12-07T17:35:36.529101+0000 mon.smithi172 (mon.0) 725 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:35:37.130 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:38.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:38 smithi172 bash[24902]: cluster 2023-12-07T17:35:38.494945+0000 mgr.smithi172.nqsqxd (mgr.14199) 1116 : cluster 0 pgmap v952: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:40.638 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:40.638 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:25:29.228081Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:25:29.227180Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:25:29.227483Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:25:29.228379Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:25:29.226859Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:25:29.226475Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:25:29.227783Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:25:29.229271Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:25:29.228974Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:25:29.230366Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:40.861 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:40 smithi172 bash[24902]: cluster 2023-12-07T17:35:40.495477+0000 mgr.smithi172.nqsqxd (mgr.14199) 1117 : cluster 0 pgmap v953: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:41.466 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:41.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:41 smithi172 bash[24902]: audit 2023-12-07T17:35:40.625799+0000 mgr.smithi172.nqsqxd (mgr.14199) 1118 : audit 0 from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:42.467 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:43.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:42 smithi172 bash[24902]: cluster 2023-12-07T17:35:42.496366+0000 mgr.smithi172.nqsqxd (mgr.14199) 1119 : cluster 0 pgmap v954: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:44.877 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:44 smithi172 bash[24902]: cluster 2023-12-07T17:35:44.496963+0000 mgr.smithi172.nqsqxd (mgr.14199) 1120 : cluster 0 pgmap v955: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:46.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:45 smithi172 bash[24902]: audit 2023-12-07T17:35:44.874326+0000 mon.smithi172 (mon.0) 726 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:35:46.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:45 smithi172 bash[24902]: audit 2023-12-07T17:35:44.883364+0000 mon.smithi172 (mon.0) 727 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:35:46.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:45 smithi172 bash[24902]: audit 2023-12-07T17:35:45.506451+0000 mon.smithi172 (mon.0) 728 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:35:46.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:45 smithi172 bash[24902]: audit 2023-12-07T17:35:45.507693+0000 mon.smithi172 (mon.0) 729 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:35:46.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:45 smithi172 bash[24902]: audit 2023-12-07T17:35:45.514808+0000 mon.smithi172 (mon.0) 730 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:35:47.030 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:47.279 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:46 smithi172 bash[24902]: cluster 2023-12-07T17:35:45.509715+0000 mgr.smithi172.nqsqxd (mgr.14199) 1121 : cluster 0 pgmap v956: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:47.279 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:46 smithi172 bash[24902]: cluster 2023-12-07T17:35:45.510108+0000 mgr.smithi172.nqsqxd (mgr.14199) 1122 : cluster 0 pgmap v957: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:49.201 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:48 smithi172 bash[24902]: cluster 2023-12-07T17:35:47.510929+0000 mgr.smithi172.nqsqxd (mgr.14199) 1123 : cluster 0 pgmap v958: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:50.231 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:49 smithi172 bash[24902]: audit 2023-12-07T17:35:49.118703+0000 mon.smithi172 (mon.0) 731 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:35:50.615 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:35:50.616 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:35:51.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:50 smithi172 bash[24902]: cluster 2023-12-07T17:35:49.511522+0000 mgr.smithi172.nqsqxd (mgr.14199) 1124 : cluster 0 pgmap v959: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:51.475 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:35:52.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:51 smithi172 bash[24902]: audit 2023-12-07T17:35:50.603894+0000 mgr.smithi172.nqsqxd (mgr.14199) 1125 : audit 0 from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:35:52.476 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:35:53.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:52 smithi172 bash[24902]: cluster 2023-12-07T17:35:51.512316+0000 mgr.smithi172.nqsqxd (mgr.14199) 1126 : cluster 0 pgmap v960: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:55.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:54 smithi172 bash[24902]: cluster 2023-12-07T17:35:53.512947+0000 mgr.smithi172.nqsqxd (mgr.14199) 1127 : cluster 0 pgmap v961: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:57.261 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:56 smithi172 bash[24902]: cluster 2023-12-07T17:35:55.513612+0000 mgr.smithi172.nqsqxd (mgr.14199) 1128 : cluster 0 pgmap v962: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:35:57.275 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:35:59.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:35:58 smithi172 bash[24902]: cluster 2023-12-07T17:35:57.514445+0000 mgr.smithi172.nqsqxd (mgr.14199) 1129 : cluster 0 pgmap v963: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:00.421 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:00.421 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:01.213 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:01.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:00 smithi172 bash[24902]: cluster 2023-12-07T17:35:59.515118+0000 mgr.smithi172.nqsqxd (mgr.14199) 1130 : cluster 0 pgmap v964: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:01.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:00 smithi172 bash[24902]: audit 2023-12-07T17:36:00.410393+0000 mgr.smithi172.nqsqxd (mgr.14199) 1131 : audit 0 from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:02.214 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:03.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:02 smithi172 bash[24902]: cluster 2023-12-07T17:36:01.515930+0000 mgr.smithi172.nqsqxd (mgr.14199) 1132 : cluster 0 pgmap v965: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:05.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:04 smithi172 bash[24902]: cluster 2023-12-07T17:36:03.516611+0000 mgr.smithi172.nqsqxd (mgr.14199) 1133 : cluster 0 pgmap v966: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:05.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:04 smithi172 bash[24902]: audit 2023-12-07T17:36:04.119016+0000 mon.smithi172 (mon.0) 732 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:36:07.017 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:07.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:06 smithi172 bash[24902]: cluster 2023-12-07T17:36:05.517211+0000 mgr.smithi172.nqsqxd (mgr.14199) 1134 : cluster 0 pgmap v967: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:09.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:08 smithi172 bash[24902]: cluster 2023-12-07T17:36:07.517679+0000 mgr.smithi172.nqsqxd (mgr.14199) 1135 : cluster 0 pgmap v968: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:10.549 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:10.549 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:11.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:10 smithi172 bash[24902]: cluster 2023-12-07T17:36:09.518275+0000 mgr.smithi172.nqsqxd (mgr.14199) 1136 : cluster 0 pgmap v969: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:11.460 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:12.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:11 smithi172 bash[24902]: audit 2023-12-07T17:36:10.535908+0000 mgr.smithi172.nqsqxd (mgr.14199) 1137 : audit 0 from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:12.461 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:13.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:12 smithi172 bash[24902]: cluster 2023-12-07T17:36:11.519200+0000 mgr.smithi172.nqsqxd (mgr.14199) 1138 : cluster 0 pgmap v970: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:15.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:14 smithi172 bash[24902]: cluster 2023-12-07T17:36:13.519831+0000 mgr.smithi172.nqsqxd (mgr.14199) 1139 : cluster 0 pgmap v971: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:17.259 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:17.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:16 smithi172 bash[24902]: cluster 2023-12-07T17:36:15.520466+0000 mgr.smithi172.nqsqxd (mgr.14199) 1140 : cluster 0 pgmap v972: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:19.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:18 smithi172 bash[24902]: cluster 2023-12-07T17:36:17.521318+0000 mgr.smithi172.nqsqxd (mgr.14199) 1141 : cluster 0 pgmap v973: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:20.357 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:19 smithi172 bash[24902]: audit 2023-12-07T17:36:19.119780+0000 mon.smithi172 (mon.0) 733 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:36:20.843 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:20.843 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:21.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:21 smithi172 bash[24902]: cluster 2023-12-07T17:36:19.522035+0000 mgr.smithi172.nqsqxd (mgr.14199) 1142 : cluster 0 pgmap v974: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:21.678 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:22.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:22 smithi172 bash[24902]: audit 2023-12-07T17:36:20.832144+0000 mgr.smithi172.nqsqxd (mgr.14199) 1143 : audit 0 from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:22.679 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:23.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:23 smithi172 bash[24902]: cluster 2023-12-07T17:36:21.522954+0000 mgr.smithi172.nqsqxd (mgr.14199) 1144 : cluster 0 pgmap v975: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:25.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:25 smithi172 bash[24902]: cluster 2023-12-07T17:36:23.523631+0000 mgr.smithi172.nqsqxd (mgr.14199) 1145 : cluster 0 pgmap v976: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:27.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:27 smithi172 bash[24902]: cluster 2023-12-07T17:36:25.524311+0000 mgr.smithi172.nqsqxd (mgr.14199) 1146 : cluster 0 pgmap v977: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:27.472 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:29.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:29 smithi172 bash[24902]: cluster 2023-12-07T17:36:27.525117+0000 mgr.smithi172.nqsqxd (mgr.14199) 1147 : cluster 0 pgmap v978: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:31.006 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:31.006 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:31.268 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:31 smithi172 bash[24902]: cluster 2023-12-07T17:36:29.525753+0000 mgr.smithi172.nqsqxd (mgr.14199) 1148 : cluster 0 pgmap v979: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:31.843 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:32.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:32 smithi172 bash[24902]: audit 2023-12-07T17:36:30.995291+0000 mgr.smithi172.nqsqxd (mgr.14199) 1149 : audit 0 from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:32.844 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:33.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:33 smithi172 bash[24902]: cluster 2023-12-07T17:36:31.526520+0000 mgr.smithi172.nqsqxd (mgr.14199) 1150 : cluster 0 pgmap v980: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:35.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:35 smithi172 bash[24902]: cluster 2023-12-07T17:36:33.527116+0000 mgr.smithi172.nqsqxd (mgr.14199) 1151 : cluster 0 pgmap v981: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:35.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:35 smithi172 bash[24902]: audit 2023-12-07T17:36:34.120151+0000 mon.smithi172 (mon.0) 734 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:36:37.279 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:37 smithi172 bash[24902]: cluster 2023-12-07T17:36:35.527777+0000 mgr.smithi172.nqsqxd (mgr.14199) 1152 : cluster 0 pgmap v982: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:37.641 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:39.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:39 smithi172 bash[24902]: cluster 2023-12-07T17:36:37.528570+0000 mgr.smithi172.nqsqxd (mgr.14199) 1153 : cluster 0 pgmap v983: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:40.915 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:40.916 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:41.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:41 smithi172 bash[24902]: cluster 2023-12-07T17:36:39.529278+0000 mgr.smithi172.nqsqxd (mgr.14199) 1154 : cluster 0 pgmap v984: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:41.791 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:42.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:42 smithi172 bash[24902]: audit 2023-12-07T17:36:40.904223+0000 mgr.smithi172.nqsqxd (mgr.14199) 1155 : audit 0 from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:42.793 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:43.127 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:43 smithi172 bash[24902]: cluster 2023-12-07T17:36:41.530091+0000 mgr.smithi172.nqsqxd (mgr.14199) 1156 : cluster 0 pgmap v985: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:45.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:45 smithi172 bash[24902]: cluster 2023-12-07T17:36:43.530734+0000 mgr.smithi172.nqsqxd (mgr.14199) 1157 : cluster 0 pgmap v986: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:46.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:46 smithi172 bash[24902]: audit 2023-12-07T17:36:45.564287+0000 mon.smithi172 (mon.0) 735 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: cluster 2023-12-07T17:36:45.531407+0000 mgr.smithi172.nqsqxd (mgr.14199) 1158 : cluster 0 pgmap v987: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: audit 2023-12-07T17:36:46.609200+0000 mon.smithi172 (mon.0) 736 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: audit 2023-12-07T17:36:46.617071+0000 mon.smithi172 (mon.0) 737 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: audit 2023-12-07T17:36:46.618824+0000 mon.smithi172 (mon.0) 738 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: audit 2023-12-07T17:36:46.620084+0000 mon.smithi172 (mon.0) 739 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:36:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:47 smithi172 bash[24902]: audit 2023-12-07T17:36:46.628845+0000 mon.smithi172 (mon.0) 740 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:36:47.582 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:48.377 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:48 smithi172 bash[24902]: cluster 2023-12-07T17:36:46.622208+0000 mgr.smithi172.nqsqxd (mgr.14199) 1159 : cluster 0 pgmap v988: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:48.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:48 smithi172 bash[24902]: cluster 2023-12-07T17:36:46.622649+0000 mgr.smithi172.nqsqxd (mgr.14199) 1160 : cluster 0 pgmap v989: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:50.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:50 smithi172 bash[24902]: cluster 2023-12-07T17:36:48.623184+0000 mgr.smithi172.nqsqxd (mgr.14199) 1161 : cluster 0 pgmap v990: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:50.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:50 smithi172 bash[24902]: audit 2023-12-07T17:36:49.120409+0000 mon.smithi172 (mon.0) 741 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:36:51.031 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:36:51.031 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:36:51.871 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:36:52.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:52 smithi172 bash[24902]: cluster 2023-12-07T17:36:50.623886+0000 mgr.smithi172.nqsqxd (mgr.14199) 1162 : cluster 0 pgmap v991: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:52.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:52 smithi172 bash[24902]: audit 2023-12-07T17:36:51.018920+0000 mgr.smithi172.nqsqxd (mgr.14199) 1163 : audit 0 from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:36:52.872 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:36:54.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:54 smithi172 bash[24902]: cluster 2023-12-07T17:36:52.624696+0000 mgr.smithi172.nqsqxd (mgr.14199) 1164 : cluster 0 pgmap v992: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:56.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:56 smithi172 bash[24902]: cluster 2023-12-07T17:36:54.625327+0000 mgr.smithi172.nqsqxd (mgr.14199) 1165 : cluster 0 pgmap v993: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:36:57.673 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:36:58.318 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:36:58 smithi172 bash[24902]: cluster 2023-12-07T17:36:56.626136+0000 mgr.smithi172.nqsqxd (mgr.14199) 1166 : cluster 0 pgmap v994: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:00.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:00 smithi172 bash[24902]: cluster 2023-12-07T17:36:58.626819+0000 mgr.smithi172.nqsqxd (mgr.14199) 1167 : cluster 0 pgmap v995: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:01.101 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:01.102 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:01.982 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:02.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:02 smithi172 bash[24902]: cluster 2023-12-07T17:37:00.627253+0000 mgr.smithi172.nqsqxd (mgr.14199) 1168 : cluster 0 pgmap v996: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:02.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:02 smithi172 bash[24902]: audit 2023-12-07T17:37:01.089575+0000 mgr.smithi172.nqsqxd (mgr.14199) 1169 : audit 0 from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:02.983 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:04.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:04 smithi172 bash[24902]: cluster 2023-12-07T17:37:02.628046+0000 mgr.smithi172.nqsqxd (mgr.14199) 1170 : cluster 0 pgmap v997: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:05.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:05 smithi172 bash[24902]: audit 2023-12-07T17:37:04.121056+0000 mon.smithi172 (mon.0) 742 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:37:06.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:06 smithi172 bash[24902]: cluster 2023-12-07T17:37:04.628703+0000 mgr.smithi172.nqsqxd (mgr.14199) 1171 : cluster 0 pgmap v998: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:07.789 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:08.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:08 smithi172 bash[24902]: cluster 2023-12-07T17:37:06.629436+0000 mgr.smithi172.nqsqxd (mgr.14199) 1172 : cluster 0 pgmap v999: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:10.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:10 smithi172 bash[24902]: cluster 2023-12-07T17:37:08.630088+0000 mgr.smithi172.nqsqxd (mgr.14199) 1173 : cluster 0 pgmap v1000: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:11.061 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:11.062 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:11.839 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:12.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:12 smithi172 bash[24902]: cluster 2023-12-07T17:37:10.630798+0000 mgr.smithi172.nqsqxd (mgr.14199) 1174 : cluster 0 pgmap v1001: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:12.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:12 smithi172 bash[24902]: audit 2023-12-07T17:37:11.048733+0000 mgr.smithi172.nqsqxd (mgr.14199) 1175 : audit 0 from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:12.840 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:14.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:14 smithi172 bash[24902]: cluster 2023-12-07T17:37:12.631527+0000 mgr.smithi172.nqsqxd (mgr.14199) 1176 : cluster 0 pgmap v1002: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:16.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:16 smithi172 bash[24902]: cluster 2023-12-07T17:37:14.632192+0000 mgr.smithi172.nqsqxd (mgr.14199) 1177 : cluster 0 pgmap v1003: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:17.634 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:18.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:18 smithi172 bash[24902]: cluster 2023-12-07T17:37:16.632993+0000 mgr.smithi172.nqsqxd (mgr.14199) 1178 : cluster 0 pgmap v1004: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:20.364 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:20 smithi172 bash[24902]: cluster 2023-12-07T17:37:18.633561+0000 mgr.smithi172.nqsqxd (mgr.14199) 1179 : cluster 0 pgmap v1005: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:20.364 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:20 smithi172 bash[24902]: audit 2023-12-07T17:37:19.121207+0000 mon.smithi172 (mon.0) 743 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:37:20.834 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:20.835 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:21.653 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:22.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:22 smithi172 bash[24902]: cluster 2023-12-07T17:37:20.634132+0000 mgr.smithi172.nqsqxd (mgr.14199) 1180 : cluster 0 pgmap v1006: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:22.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:22 smithi172 bash[24902]: audit 2023-12-07T17:37:20.826852+0000 mgr.smithi172.nqsqxd (mgr.14199) 1181 : audit 0 from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:22.654 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:24.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:24 smithi172 bash[24902]: cluster 2023-12-07T17:37:22.634970+0000 mgr.smithi172.nqsqxd (mgr.14199) 1182 : cluster 0 pgmap v1007: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:26.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:26 smithi172 bash[24902]: cluster 2023-12-07T17:37:24.635682+0000 mgr.smithi172.nqsqxd (mgr.14199) 1183 : cluster 0 pgmap v1008: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:27.451 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:28.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:28 smithi172 bash[24902]: cluster 2023-12-07T17:37:26.636449+0000 mgr.smithi172.nqsqxd (mgr.14199) 1184 : cluster 0 pgmap v1009: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:30.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:30 smithi172 bash[24902]: cluster 2023-12-07T17:37:28.637219+0000 mgr.smithi172.nqsqxd (mgr.14199) 1185 : cluster 0 pgmap v1010: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:30.803 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:30.803 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:31.643 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:32.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:32 smithi172 bash[24902]: cluster 2023-12-07T17:37:30.637921+0000 mgr.smithi172.nqsqxd (mgr.14199) 1186 : cluster 0 pgmap v1011: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:32.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:32 smithi172 bash[24902]: audit 2023-12-07T17:37:30.789615+0000 mgr.smithi172.nqsqxd (mgr.14199) 1187 : audit 0 from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:32.644 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:34.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:34 smithi172 bash[24902]: cluster 2023-12-07T17:37:32.638876+0000 mgr.smithi172.nqsqxd (mgr.14199) 1188 : cluster 0 pgmap v1012: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:35.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:35 smithi172 bash[24902]: audit 2023-12-07T17:37:34.121616+0000 mon.smithi172 (mon.0) 744 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:37:36.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:36 smithi172 bash[24902]: cluster 2023-12-07T17:37:34.639554+0000 mgr.smithi172.nqsqxd (mgr.14199) 1189 : cluster 0 pgmap v1013: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:37.440 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:38.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:38 smithi172 bash[24902]: cluster 2023-12-07T17:37:36.640566+0000 mgr.smithi172.nqsqxd (mgr.14199) 1190 : cluster 0 pgmap v1014: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:40.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:40 smithi172 bash[24902]: cluster 2023-12-07T17:37:38.641285+0000 mgr.smithi172.nqsqxd (mgr.14199) 1191 : cluster 0 pgmap v1015: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:40.706 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:40.706 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:41.560 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:42.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:42 smithi172 bash[24902]: cluster 2023-12-07T17:37:40.642035+0000 mgr.smithi172.nqsqxd (mgr.14199) 1192 : cluster 0 pgmap v1016: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:42.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:42 smithi172 bash[24902]: audit 2023-12-07T17:37:40.695244+0000 mgr.smithi172.nqsqxd (mgr.14199) 1193 : audit 0 from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:42.562 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:44.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:44 smithi172 bash[24902]: cluster 2023-12-07T17:37:42.642755+0000 mgr.smithi172.nqsqxd (mgr.14199) 1194 : cluster 0 pgmap v1017: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:46.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:46 smithi172 bash[24902]: cluster 2023-12-07T17:37:44.643388+0000 mgr.smithi172.nqsqxd (mgr.14199) 1195 : cluster 0 pgmap v1018: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:47.350 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:47.381 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:47 smithi172 bash[24902]: audit 2023-12-07T17:37:46.681688+0000 mon.smithi172 (mon.0) 745 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:37:48.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: cluster 2023-12-07T17:37:46.644182+0000 mgr.smithi172.nqsqxd (mgr.14199) 1196 : cluster 0 pgmap v1019: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:48.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: audit 2023-12-07T17:37:47.303619+0000 mon.smithi172 (mon.0) 746 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:37:48.457 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: audit 2023-12-07T17:37:47.305448+0000 mon.smithi172 (mon.0) 747 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:37:48.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: cluster 2023-12-07T17:37:47.308401+0000 mgr.smithi172.nqsqxd (mgr.14199) 1197 : cluster 0 pgmap v1020: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:48.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: cluster 2023-12-07T17:37:47.308857+0000 mgr.smithi172.nqsqxd (mgr.14199) 1198 : cluster 0 pgmap v1021: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:48.458 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:48 smithi172 bash[24902]: audit 2023-12-07T17:37:47.313569+0000 mon.smithi172 (mon.0) 748 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:37:49.442 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:49 smithi172 bash[24902]: audit 2023-12-07T17:37:49.121315+0000 mon.smithi172 (mon.0) 749 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:37:50.417 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:50 smithi172 bash[24902]: cluster 2023-12-07T17:37:49.309468+0000 mgr.smithi172.nqsqxd (mgr.14199) 1199 : cluster 0 pgmap v1022: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:50.870 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:37:50.871 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:37:51.727 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:37:52.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:52 smithi172 bash[24902]: audit 2023-12-07T17:37:50.857738+0000 mgr.smithi172.nqsqxd (mgr.14199) 1200 : audit 0 from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:37:52.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:52 smithi172 bash[24902]: cluster 2023-12-07T17:37:51.309928+0000 mgr.smithi172.nqsqxd (mgr.14199) 1201 : cluster 0 pgmap v1023: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:52.727 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:37:54.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:54 smithi172 bash[24902]: cluster 2023-12-07T17:37:53.310659+0000 mgr.smithi172.nqsqxd (mgr.14199) 1202 : cluster 0 pgmap v1024: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:56.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:56 smithi172 bash[24902]: cluster 2023-12-07T17:37:55.311285+0000 mgr.smithi172.nqsqxd (mgr.14199) 1203 : cluster 0 pgmap v1025: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:37:57.526 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:37:58.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:37:57 smithi172 bash[24902]: cluster 2023-12-07T17:37:57.312308+0000 mgr.smithi172.nqsqxd (mgr.14199) 1204 : cluster 0 pgmap v1026: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:00.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:00 smithi172 bash[24902]: cluster 2023-12-07T17:37:59.313033+0000 mgr.smithi172.nqsqxd (mgr.14199) 1205 : cluster 0 pgmap v1027: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:00.912 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:00.912 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:01.759 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:02.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:02 smithi172 bash[24902]: audit 2023-12-07T17:38:00.900125+0000 mgr.smithi172.nqsqxd (mgr.14199) 1206 : audit 0 from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:02.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:02 smithi172 bash[24902]: cluster 2023-12-07T17:38:01.313863+0000 mgr.smithi172.nqsqxd (mgr.14199) 1207 : cluster 0 pgmap v1028: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:02.761 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:04.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:04 smithi172 bash[24902]: cluster 2023-12-07T17:38:03.314630+0000 mgr.smithi172.nqsqxd (mgr.14199) 1208 : cluster 0 pgmap v1029: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:04.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:04 smithi172 bash[24902]: audit 2023-12-07T17:38:04.122288+0000 mon.smithi172 (mon.0) 750 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:38:06.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:06 smithi172 bash[24902]: cluster 2023-12-07T17:38:05.315426+0000 mgr.smithi172.nqsqxd (mgr.14199) 1209 : cluster 0 pgmap v1030: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:07.561 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:08.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:08 smithi172 bash[24902]: cluster 2023-12-07T17:38:07.316381+0000 mgr.smithi172.nqsqxd (mgr.14199) 1210 : cluster 0 pgmap v1031: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:10.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:10 smithi172 bash[24902]: cluster 2023-12-07T17:38:09.316999+0000 mgr.smithi172.nqsqxd (mgr.14199) 1211 : cluster 0 pgmap v1032: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:11.049 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:11.049 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:11.846 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:12.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:12 smithi172 bash[24902]: audit 2023-12-07T17:38:11.041459+0000 mgr.smithi172.nqsqxd (mgr.14199) 1212 : audit 0 from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:12.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:12 smithi172 bash[24902]: cluster 2023-12-07T17:38:11.317775+0000 mgr.smithi172.nqsqxd (mgr.14199) 1213 : cluster 0 pgmap v1033: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:12.847 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:14.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:14 smithi172 bash[24902]: cluster 2023-12-07T17:38:13.318535+0000 mgr.smithi172.nqsqxd (mgr.14199) 1214 : cluster 0 pgmap v1034: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:16.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:16 smithi172 bash[24902]: cluster 2023-12-07T17:38:15.319148+0000 mgr.smithi172.nqsqxd (mgr.14199) 1215 : cluster 0 pgmap v1035: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:17.635 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:18.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:18 smithi172 bash[24902]: cluster 2023-12-07T17:38:17.319983+0000 mgr.smithi172.nqsqxd (mgr.14199) 1216 : cluster 0 pgmap v1036: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:19.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:19 smithi172 bash[24902]: audit 2023-12-07T17:38:19.123090+0000 mon.smithi172 (mon.0) 751 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:38:20.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:20 smithi172 bash[24902]: cluster 2023-12-07T17:38:19.320452+0000 mgr.smithi172.nqsqxd (mgr.14199) 1217 : cluster 0 pgmap v1037: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:21.370 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:21.370 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:22.139 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:22.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:22 smithi172 bash[24902]: cluster 2023-12-07T17:38:21.321117+0000 mgr.smithi172.nqsqxd (mgr.14199) 1218 : cluster 0 pgmap v1038: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:22.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:22 smithi172 bash[24902]: audit 2023-12-07T17:38:21.355466+0000 mgr.smithi172.nqsqxd (mgr.14199) 1219 : audit 0 from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:23.139 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:24.854 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:24 smithi172 bash[24902]: cluster 2023-12-07T17:38:23.321608+0000 mgr.smithi172.nqsqxd (mgr.14199) 1220 : cluster 0 pgmap v1039: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:26.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:26 smithi172 bash[24902]: cluster 2023-12-07T17:38:25.322191+0000 mgr.smithi172.nqsqxd (mgr.14199) 1221 : cluster 0 pgmap v1040: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:27.938 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:28.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:28 smithi172 bash[24902]: cluster 2023-12-07T17:38:27.323006+0000 mgr.smithi172.nqsqxd (mgr.14199) 1222 : cluster 0 pgmap v1041: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:30.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:30 smithi172 bash[24902]: cluster 2023-12-07T17:38:29.323653+0000 mgr.smithi172.nqsqxd (mgr.14199) 1223 : cluster 0 pgmap v1042: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:31.374 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:31.374 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:32.134 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:32 smithi172 bash[24902]: cluster 2023-12-07T17:38:31.324393+0000 mgr.smithi172.nqsqxd (mgr.14199) 1224 : cluster 0 pgmap v1043: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:32.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:32 smithi172 bash[24902]: audit 2023-12-07T17:38:31.359850+0000 mgr.smithi172.nqsqxd (mgr.14199) 1225 : audit 0 from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:33.135 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:34.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:34 smithi172 bash[24902]: cluster 2023-12-07T17:38:33.324996+0000 mgr.smithi172.nqsqxd (mgr.14199) 1226 : cluster 0 pgmap v1044: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:34.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:34 smithi172 bash[24902]: audit 2023-12-07T17:38:34.123148+0000 mon.smithi172 (mon.0) 752 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:38:36.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:36 smithi172 bash[24902]: cluster 2023-12-07T17:38:35.325646+0000 mgr.smithi172.nqsqxd (mgr.14199) 1227 : cluster 0 pgmap v1045: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:37.932 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:38.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:38 smithi172 bash[24902]: cluster 2023-12-07T17:38:37.326496+0000 mgr.smithi172.nqsqxd (mgr.14199) 1228 : cluster 0 pgmap v1046: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:40.741 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:40 smithi172 bash[24902]: cluster 2023-12-07T17:38:39.326896+0000 mgr.smithi172.nqsqxd (mgr.14199) 1229 : cluster 0 pgmap v1047: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:41.233 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:41.234 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:42.054 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:42.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:42 smithi172 bash[24902]: audit 2023-12-07T17:38:41.219117+0000 mgr.smithi172.nqsqxd (mgr.14199) 1230 : audit 0 from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:42.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:42 smithi172 bash[24902]: cluster 2023-12-07T17:38:41.327536+0000 mgr.smithi172.nqsqxd (mgr.14199) 1231 : cluster 0 pgmap v1048: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:43.055 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:44.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:44 smithi172 bash[24902]: cluster 2023-12-07T17:38:43.328261+0000 mgr.smithi172.nqsqxd (mgr.14199) 1232 : cluster 0 pgmap v1049: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:46.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:46 smithi172 bash[24902]: cluster 2023-12-07T17:38:45.328933+0000 mgr.smithi172.nqsqxd (mgr.14199) 1233 : cluster 0 pgmap v1050: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:47.851 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:48.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:48 smithi172 bash[24902]: cluster 2023-12-07T17:38:47.329614+0000 mgr.smithi172.nqsqxd (mgr.14199) 1234 : cluster 0 pgmap v1051: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:48.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:48 smithi172 bash[24902]: audit 2023-12-07T17:38:47.364672+0000 mon.smithi172 (mon.0) 753 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:38:48.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:48 smithi172 bash[24902]: audit 2023-12-07T17:38:47.986781+0000 mon.smithi172 (mon.0) 754 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:38:48.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:48 smithi172 bash[24902]: audit 2023-12-07T17:38:47.988390+0000 mon.smithi172 (mon.0) 755 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:38:48.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:48 smithi172 bash[24902]: audit 2023-12-07T17:38:47.997198+0000 mon.smithi172 (mon.0) 756 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:38:49.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:49 smithi172 bash[24902]: cluster 2023-12-07T17:38:47.990847+0000 mgr.smithi172.nqsqxd (mgr.14199) 1235 : cluster 0 pgmap v1052: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:49.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:49 smithi172 bash[24902]: cluster 2023-12-07T17:38:47.991306+0000 mgr.smithi172.nqsqxd (mgr.14199) 1236 : cluster 0 pgmap v1053: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:50.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:50 smithi172 bash[24902]: audit 2023-12-07T17:38:49.123518+0000 mon.smithi172 (mon.0) 757 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:38:51.091 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:38:51.092 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:38:51.328 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:51 smithi172 bash[24902]: cluster 2023-12-07T17:38:49.991892+0000 mgr.smithi172.nqsqxd (mgr.14199) 1237 : cluster 0 pgmap v1054: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:51.865 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:38:52.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:52 smithi172 bash[24902]: audit 2023-12-07T17:38:51.079197+0000 mgr.smithi172.nqsqxd (mgr.14199) 1238 : audit 0 from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:38:52.866 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:38:53.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:53 smithi172 bash[24902]: cluster 2023-12-07T17:38:51.992777+0000 mgr.smithi172.nqsqxd (mgr.14199) 1239 : cluster 0 pgmap v1055: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:55.366 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:55 smithi172 bash[24902]: cluster 2023-12-07T17:38:53.993490+0000 mgr.smithi172.nqsqxd (mgr.14199) 1240 : cluster 0 pgmap v1056: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:57.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:57 smithi172 bash[24902]: cluster 2023-12-07T17:38:55.994271+0000 mgr.smithi172.nqsqxd (mgr.14199) 1241 : cluster 0 pgmap v1057: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:38:57.662 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:38:59.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:38:59 smithi172 bash[24902]: cluster 2023-12-07T17:38:57.995046+0000 mgr.smithi172.nqsqxd (mgr.14199) 1242 : cluster 0 pgmap v1058: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:00.872 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:00.872 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:01.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:01 smithi172 bash[24902]: cluster 2023-12-07T17:38:59.995546+0000 mgr.smithi172.nqsqxd (mgr.14199) 1243 : cluster 0 pgmap v1059: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:01.721 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:02.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:02 smithi172 bash[24902]: audit 2023-12-07T17:39:00.864183+0000 mgr.smithi172.nqsqxd (mgr.14199) 1244 : audit 0 from='client.14848 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:02.722 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:03.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:03 smithi172 bash[24902]: cluster 2023-12-07T17:39:01.996331+0000 mgr.smithi172.nqsqxd (mgr.14199) 1245 : cluster 0 pgmap v1060: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:05.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:05 smithi172 bash[24902]: cluster 2023-12-07T17:39:03.997158+0000 mgr.smithi172.nqsqxd (mgr.14199) 1246 : cluster 0 pgmap v1061: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:05.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:05 smithi172 bash[24902]: audit 2023-12-07T17:39:04.123898+0000 mon.smithi172 (mon.0) 758 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:39:07.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:07 smithi172 bash[24902]: cluster 2023-12-07T17:39:05.998044+0000 mgr.smithi172.nqsqxd (mgr.14199) 1247 : cluster 0 pgmap v1062: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:07.522 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:09.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:09 smithi172 bash[24902]: cluster 2023-12-07T17:39:07.998964+0000 mgr.smithi172.nqsqxd (mgr.14199) 1248 : cluster 0 pgmap v1063: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:10.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:10.948 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:11.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:11 smithi172 bash[24902]: cluster 2023-12-07T17:39:09.999666+0000 mgr.smithi172.nqsqxd (mgr.14199) 1249 : cluster 0 pgmap v1064: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:11.785 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:12.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:12 smithi172 bash[24902]: audit 2023-12-07T17:39:10.935627+0000 mgr.smithi172.nqsqxd (mgr.14199) 1250 : audit 0 from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:12.786 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:13.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:13 smithi172 bash[24902]: cluster 2023-12-07T17:39:12.000549+0000 mgr.smithi172.nqsqxd (mgr.14199) 1251 : cluster 0 pgmap v1065: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:15.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:15 smithi172 bash[24902]: cluster 2023-12-07T17:39:14.001030+0000 mgr.smithi172.nqsqxd (mgr.14199) 1252 : cluster 0 pgmap v1066: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:17.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:17 smithi172 bash[24902]: cluster 2023-12-07T17:39:16.001765+0000 mgr.smithi172.nqsqxd (mgr.14199) 1253 : cluster 0 pgmap v1067: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:17.580 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:19.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:19 smithi172 bash[24902]: cluster 2023-12-07T17:39:18.002550+0000 mgr.smithi172.nqsqxd (mgr.14199) 1254 : cluster 0 pgmap v1068: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:20.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:20 smithi172 bash[24902]: audit 2023-12-07T17:39:19.124283+0000 mon.smithi172 (mon.0) 759 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:39:20.903 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:20.903 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:21.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:21 smithi172 bash[24902]: cluster 2023-12-07T17:39:20.003170+0000 mgr.smithi172.nqsqxd (mgr.14199) 1255 : cluster 0 pgmap v1069: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:21.782 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:22.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:22 smithi172 bash[24902]: audit 2023-12-07T17:39:20.890138+0000 mgr.smithi172.nqsqxd (mgr.14199) 1256 : audit 0 from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:22.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:23.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:23 smithi172 bash[24902]: cluster 2023-12-07T17:39:22.004040+0000 mgr.smithi172.nqsqxd (mgr.14199) 1257 : cluster 0 pgmap v1070: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:25.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:25 smithi172 bash[24902]: cluster 2023-12-07T17:39:24.004564+0000 mgr.smithi172.nqsqxd (mgr.14199) 1258 : cluster 0 pgmap v1071: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:27.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:27 smithi172 bash[24902]: cluster 2023-12-07T17:39:26.005291+0000 mgr.smithi172.nqsqxd (mgr.14199) 1259 : cluster 0 pgmap v1072: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:27.588 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:29.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:29 smithi172 bash[24902]: cluster 2023-12-07T17:39:28.006081+0000 mgr.smithi172.nqsqxd (mgr.14199) 1260 : cluster 0 pgmap v1073: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:30.936 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:30.937 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:31.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:31 smithi172 bash[24902]: cluster 2023-12-07T17:39:30.006711+0000 mgr.smithi172.nqsqxd (mgr.14199) 1261 : cluster 0 pgmap v1074: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:31.795 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:32.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:32 smithi172 bash[24902]: audit 2023-12-07T17:39:30.925217+0000 mgr.smithi172.nqsqxd (mgr.14199) 1262 : audit 0 from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:32.796 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:33.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:33 smithi172 bash[24902]: cluster 2023-12-07T17:39:32.007510+0000 mgr.smithi172.nqsqxd (mgr.14199) 1263 : cluster 0 pgmap v1075: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:35.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:35 smithi172 bash[24902]: cluster 2023-12-07T17:39:34.008080+0000 mgr.smithi172.nqsqxd (mgr.14199) 1264 : cluster 0 pgmap v1076: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:35.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:35 smithi172 bash[24902]: audit 2023-12-07T17:39:34.124684+0000 mon.smithi172 (mon.0) 760 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:39:37.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:37 smithi172 bash[24902]: cluster 2023-12-07T17:39:36.008861+0000 mgr.smithi172.nqsqxd (mgr.14199) 1265 : cluster 0 pgmap v1077: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:37.591 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:39.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:39 smithi172 bash[24902]: cluster 2023-12-07T17:39:38.009584+0000 mgr.smithi172.nqsqxd (mgr.14199) 1266 : cluster 0 pgmap v1078: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:40.963 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:40.963 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:41.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:41 smithi172 bash[24902]: cluster 2023-12-07T17:39:40.010232+0000 mgr.smithi172.nqsqxd (mgr.14199) 1267 : cluster 0 pgmap v1079: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:41.798 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:42.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:42 smithi172 bash[24902]: audit 2023-12-07T17:39:40.955074+0000 mgr.smithi172.nqsqxd (mgr.14199) 1268 : audit 0 from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:42.799 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:43.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:43 smithi172 bash[24902]: cluster 2023-12-07T17:39:42.011084+0000 mgr.smithi172.nqsqxd (mgr.14199) 1269 : cluster 0 pgmap v1080: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:45.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:45 smithi172 bash[24902]: cluster 2023-12-07T17:39:44.011731+0000 mgr.smithi172.nqsqxd (mgr.14199) 1270 : cluster 0 pgmap v1081: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:47.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:47 smithi172 bash[24902]: cluster 2023-12-07T17:39:46.012473+0000 mgr.smithi172.nqsqxd (mgr.14199) 1271 : cluster 0 pgmap v1082: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:47.593 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:48.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:48 smithi172 bash[24902]: audit 2023-12-07T17:39:48.044555+0000 mon.smithi172 (mon.0) 761 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:39:49.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:49 smithi172 bash[24902]: cluster 2023-12-07T17:39:48.013229+0000 mgr.smithi172.nqsqxd (mgr.14199) 1272 : cluster 0 pgmap v1083: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:50.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:50 smithi172 bash[24902]: audit 2023-12-07T17:39:49.124187+0000 mon.smithi172 (mon.0) 762 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:39:50.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:39:50.948 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:39:51.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:51 smithi172 bash[24902]: cluster 2023-12-07T17:39:50.013669+0000 mgr.smithi172.nqsqxd (mgr.14199) 1273 : cluster 0 pgmap v1084: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:51.694 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:39:52.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:52 smithi172 bash[24902]: audit 2023-12-07T17:39:50.936006+0000 mgr.smithi172.nqsqxd (mgr.14199) 1274 : audit 0 from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:39:52.695 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:39:53.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:53 smithi172 bash[24902]: cluster 2023-12-07T17:39:52.014400+0000 mgr.smithi172.nqsqxd (mgr.14199) 1275 : cluster 0 pgmap v1085: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:55.400 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:55 smithi172 bash[24902]: cluster 2023-12-07T17:39:54.015089+0000 mgr.smithi172.nqsqxd (mgr.14199) 1276 : cluster 0 pgmap v1086: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:57.275 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:39:57.278 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:57 smithi172 bash[24902]: cluster 2023-12-07T17:39:56.015796+0000 mgr.smithi172.nqsqxd (mgr.14199) 1277 : cluster 0 pgmap v1087: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:39:59.417 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:39:59 smithi172 bash[24902]: cluster 2023-12-07T17:39:58.016597+0000 mgr.smithi172.nqsqxd (mgr.14199) 1278 : cluster 0 pgmap v1088: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:01.009 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:01.009 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:01.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: cluster 2023-12-07T17:40:00.017033+0000 mgr.smithi172.nqsqxd (mgr.14199) 1279 : cluster 0 pgmap v1089: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: audit 2023-12-07T17:40:00.263068+0000 mon.smithi172 (mon.0) 763 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: audit 2023-12-07T17:40:00.269155+0000 mon.smithi172 (mon.0) 764 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: audit 2023-12-07T17:40:00.270966+0000 mon.smithi172 (mon.0) 765 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: audit 2023-12-07T17:40:00.272036+0000 mon.smithi172 (mon.0) 766 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: cluster 2023-12-07T17:40:00.273656+0000 mgr.smithi172.nqsqxd (mgr.14199) 1280 : cluster 0 pgmap v1090: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: cluster 2023-12-07T17:40:00.273879+0000 mgr.smithi172.nqsqxd (mgr.14199) 1281 : cluster 0 pgmap v1091: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:01.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:01 smithi172 bash[24902]: audit 2023-12-07T17:40:00.279084+0000 mon.smithi172 (mon.0) 767 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:40:01.865 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:02.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:02 smithi172 bash[24902]: audit 2023-12-07T17:40:00.997296+0000 mgr.smithi172.nqsqxd (mgr.14199) 1282 : audit 0 from='client.14860 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:02.865 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:03.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:03 smithi172 bash[24902]: cluster 2023-12-07T17:40:02.274680+0000 mgr.smithi172.nqsqxd (mgr.14199) 1283 : cluster 0 pgmap v1092: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:04.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:04 smithi172 bash[24902]: audit 2023-12-07T17:40:04.125421+0000 mon.smithi172 (mon.0) 768 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:40:05.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:05 smithi172 bash[24902]: cluster 2023-12-07T17:40:04.275318+0000 mgr.smithi172.nqsqxd (mgr.14199) 1284 : cluster 0 pgmap v1093: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:07.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:07 smithi172 bash[24902]: cluster 2023-12-07T17:40:06.276088+0000 mgr.smithi172.nqsqxd (mgr.14199) 1285 : cluster 0 pgmap v1094: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:07.660 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:09.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:09 smithi172 bash[24902]: cluster 2023-12-07T17:40:08.276762+0000 mgr.smithi172.nqsqxd (mgr.14199) 1286 : cluster 0 pgmap v1095: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:11.177 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:11.177 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:11.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:11 smithi172 bash[24902]: cluster 2023-12-07T17:40:10.277209+0000 mgr.smithi172.nqsqxd (mgr.14199) 1287 : cluster 0 pgmap v1096: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:12.002 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:12.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:12 smithi172 bash[24902]: audit 2023-12-07T17:40:11.168758+0000 mgr.smithi172.nqsqxd (mgr.14199) 1288 : audit 0 from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:13.004 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:13.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:13 smithi172 bash[24902]: cluster 2023-12-07T17:40:12.277959+0000 mgr.smithi172.nqsqxd (mgr.14199) 1289 : cluster 0 pgmap v1097: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:15.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:15 smithi172 bash[24902]: cluster 2023-12-07T17:40:14.278589+0000 mgr.smithi172.nqsqxd (mgr.14199) 1290 : cluster 0 pgmap v1098: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:17.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:17 smithi172 bash[24902]: cluster 2023-12-07T17:40:16.279360+0000 mgr.smithi172.nqsqxd (mgr.14199) 1291 : cluster 0 pgmap v1099: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:17.796 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:19.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:19 smithi172 bash[24902]: cluster 2023-12-07T17:40:18.279955+0000 mgr.smithi172.nqsqxd (mgr.14199) 1292 : cluster 0 pgmap v1100: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:19.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:19 smithi172 bash[24902]: audit 2023-12-07T17:40:19.125869+0000 mon.smithi172 (mon.0) 769 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:40:20.951 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:20.951 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:21.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:21 smithi172 bash[24902]: cluster 2023-12-07T17:40:20.280411+0000 mgr.smithi172.nqsqxd (mgr.14199) 1293 : cluster 0 pgmap v1101: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:21.706 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:22.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:22 smithi172 bash[24902]: audit 2023-12-07T17:40:20.937952+0000 mgr.smithi172.nqsqxd (mgr.14199) 1294 : audit 0 from='client.14864 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:22.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:23.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:23 smithi172 bash[24902]: cluster 2023-12-07T17:40:22.281261+0000 mgr.smithi172.nqsqxd (mgr.14199) 1295 : cluster 0 pgmap v1102: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:25.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:25 smithi172 bash[24902]: cluster 2023-12-07T17:40:24.281908+0000 mgr.smithi172.nqsqxd (mgr.14199) 1296 : cluster 0 pgmap v1103: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:27.503 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:27.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:27 smithi172 bash[24902]: cluster 2023-12-07T17:40:26.282758+0000 mgr.smithi172.nqsqxd (mgr.14199) 1297 : cluster 0 pgmap v1104: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:29.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:29 smithi172 bash[24902]: cluster 2023-12-07T17:40:28.283370+0000 mgr.smithi172.nqsqxd (mgr.14199) 1298 : cluster 0 pgmap v1105: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:30.770 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:30.770 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:31.549 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:31.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:31 smithi172 bash[24902]: cluster 2023-12-07T17:40:30.284068+0000 mgr.smithi172.nqsqxd (mgr.14199) 1299 : cluster 0 pgmap v1106: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:32.551 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:32.563 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:32 smithi172 bash[24902]: audit 2023-12-07T17:40:30.756109+0000 mgr.smithi172.nqsqxd (mgr.14199) 1300 : audit 0 from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:33.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:33 smithi172 bash[24902]: cluster 2023-12-07T17:40:32.284856+0000 mgr.smithi172.nqsqxd (mgr.14199) 1301 : cluster 0 pgmap v1107: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:34.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:34 smithi172 bash[24902]: audit 2023-12-07T17:40:34.126202+0000 mon.smithi172 (mon.0) 770 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:40:35.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:35 smithi172 bash[24902]: cluster 2023-12-07T17:40:34.285534+0000 mgr.smithi172.nqsqxd (mgr.14199) 1302 : cluster 0 pgmap v1108: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:37.347 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:37.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:37 smithi172 bash[24902]: cluster 2023-12-07T17:40:36.286509+0000 mgr.smithi172.nqsqxd (mgr.14199) 1303 : cluster 0 pgmap v1109: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:39.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:39 smithi172 bash[24902]: cluster 2023-12-07T17:40:38.287143+0000 mgr.smithi172.nqsqxd (mgr.14199) 1304 : cluster 0 pgmap v1110: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:40.538 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:40.538 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:41.323 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:41.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:41 smithi172 bash[24902]: cluster 2023-12-07T17:40:40.287721+0000 mgr.smithi172.nqsqxd (mgr.14199) 1305 : cluster 0 pgmap v1111: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:41.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:41 smithi172 bash[24902]: audit 2023-12-07T17:40:40.526271+0000 mgr.smithi172.nqsqxd (mgr.14199) 1306 : audit 0 from='client.14868 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:42.324 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:43.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:43 smithi172 bash[24902]: cluster 2023-12-07T17:40:42.288388+0000 mgr.smithi172.nqsqxd (mgr.14199) 1307 : cluster 0 pgmap v1112: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:45.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:45 smithi172 bash[24902]: cluster 2023-12-07T17:40:44.289034+0000 mgr.smithi172.nqsqxd (mgr.14199) 1308 : cluster 0 pgmap v1113: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:47.119 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:47.443 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:47 smithi172 bash[24902]: cluster 2023-12-07T17:40:46.289726+0000 mgr.smithi172.nqsqxd (mgr.14199) 1309 : cluster 0 pgmap v1114: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:49.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:49 smithi172 bash[24902]: cluster 2023-12-07T17:40:48.290337+0000 mgr.smithi172.nqsqxd (mgr.14199) 1310 : cluster 0 pgmap v1115: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:49.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:49 smithi172 bash[24902]: audit 2023-12-07T17:40:49.126023+0000 mon.smithi172 (mon.0) 771 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:40:50.534 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:40:50.534 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:40:51.336 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:40:51.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:51 smithi172 bash[24902]: cluster 2023-12-07T17:40:50.290883+0000 mgr.smithi172.nqsqxd (mgr.14199) 1311 : cluster 0 pgmap v1116: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:51.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:51 smithi172 bash[24902]: audit 2023-12-07T17:40:50.525959+0000 mgr.smithi172.nqsqxd (mgr.14199) 1312 : audit 0 from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:40:52.337 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:40:53.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:53 smithi172 bash[24902]: cluster 2023-12-07T17:40:52.291624+0000 mgr.smithi172.nqsqxd (mgr.14199) 1313 : cluster 0 pgmap v1117: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:55.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:55 smithi172 bash[24902]: cluster 2023-12-07T17:40:54.292355+0000 mgr.smithi172.nqsqxd (mgr.14199) 1314 : cluster 0 pgmap v1118: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:57.129 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:40:57.624 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:57 smithi172 bash[24902]: cluster 2023-12-07T17:40:56.293298+0000 mgr.smithi172.nqsqxd (mgr.14199) 1315 : cluster 0 pgmap v1119: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:40:59.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:40:59 smithi172 bash[24902]: cluster 2023-12-07T17:40:58.294076+0000 mgr.smithi172.nqsqxd (mgr.14199) 1316 : cluster 0 pgmap v1120: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:00.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:00 smithi172 bash[24902]: audit 2023-12-07T17:41:00.329024+0000 mon.smithi172 (mon.0) 772 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:41:00.658 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:00.659 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:01.467 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:01 smithi172 bash[24902]: cluster 2023-12-07T17:41:00.294562+0000 mgr.smithi172.nqsqxd (mgr.14199) 1317 : cluster 0 pgmap v1121: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:01 smithi172 bash[24902]: audit 2023-12-07T17:41:00.908650+0000 mon.smithi172 (mon.0) 773 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:41:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:01 smithi172 bash[24902]: audit 2023-12-07T17:41:00.909624+0000 mon.smithi172 (mon.0) 774 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:41:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:01 smithi172 bash[24902]: audit 2023-12-07T17:41:00.916500+0000 mon.smithi172 (mon.0) 775 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:41:02.468 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:02.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:02 smithi172 bash[24902]: audit 2023-12-07T17:41:00.644717+0000 mgr.smithi172.nqsqxd (mgr.14199) 1318 : audit 0 from='client.14872 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:02.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:02 smithi172 bash[24902]: cluster 2023-12-07T17:41:00.911107+0000 mgr.smithi172.nqsqxd (mgr.14199) 1319 : cluster 0 pgmap v1122: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:02.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:02 smithi172 bash[24902]: cluster 2023-12-07T17:41:00.911322+0000 mgr.smithi172.nqsqxd (mgr.14199) 1320 : cluster 0 pgmap v1123: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:04 smithi172 bash[24902]: cluster 2023-12-07T17:41:02.912036+0000 mgr.smithi172.nqsqxd (mgr.14199) 1321 : cluster 0 pgmap v1124: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:04 smithi172 bash[24902]: audit 2023-12-07T17:41:04.127060+0000 mon.smithi172 (mon.0) 776 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:41:06.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:06 smithi172 bash[24902]: cluster 2023-12-07T17:41:04.912700+0000 mgr.smithi172.nqsqxd (mgr.14199) 1322 : cluster 0 pgmap v1125: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:07.259 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:08.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:08 smithi172 bash[24902]: cluster 2023-12-07T17:41:06.913497+0000 mgr.smithi172.nqsqxd (mgr.14199) 1323 : cluster 0 pgmap v1126: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:10.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:10 smithi172 bash[24902]: cluster 2023-12-07T17:41:08.914096+0000 mgr.smithi172.nqsqxd (mgr.14199) 1324 : cluster 0 pgmap v1127: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:10.712 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:10.712 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:11.520 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:12.522 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:12.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:12 smithi172 bash[24902]: audit 2023-12-07T17:41:10.700146+0000 mgr.smithi172.nqsqxd (mgr.14199) 1325 : audit 0 from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:12.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:12 smithi172 bash[24902]: cluster 2023-12-07T17:41:10.914759+0000 mgr.smithi172.nqsqxd (mgr.14199) 1326 : cluster 0 pgmap v1128: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:14.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:14 smithi172 bash[24902]: cluster 2023-12-07T17:41:12.915429+0000 mgr.smithi172.nqsqxd (mgr.14199) 1327 : cluster 0 pgmap v1129: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:16.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:16 smithi172 bash[24902]: cluster 2023-12-07T17:41:14.916081+0000 mgr.smithi172.nqsqxd (mgr.14199) 1328 : cluster 0 pgmap v1130: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:17.318 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:18.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:18 smithi172 bash[24902]: cluster 2023-12-07T17:41:16.916844+0000 mgr.smithi172.nqsqxd (mgr.14199) 1329 : cluster 0 pgmap v1131: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:19.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:19 smithi172 bash[24902]: audit 2023-12-07T17:41:19.127001+0000 mon.smithi172 (mon.0) 777 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:41:20.558 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:20.559 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:20.800 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:20 smithi172 bash[24902]: cluster 2023-12-07T17:41:18.917520+0000 mgr.smithi172.nqsqxd (mgr.14199) 1330 : cluster 0 pgmap v1132: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:21.406 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:21.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:21 smithi172 bash[24902]: audit 2023-12-07T17:41:20.546599+0000 mgr.smithi172.nqsqxd (mgr.14199) 1331 : audit 0 from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:22.407 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:22.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:22 smithi172 bash[24902]: cluster 2023-12-07T17:41:20.917966+0000 mgr.smithi172.nqsqxd (mgr.14199) 1332 : cluster 0 pgmap v1133: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:24.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:24 smithi172 bash[24902]: cluster 2023-12-07T17:41:22.918773+0000 mgr.smithi172.nqsqxd (mgr.14199) 1333 : cluster 0 pgmap v1134: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:26.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:26 smithi172 bash[24902]: cluster 2023-12-07T17:41:24.919400+0000 mgr.smithi172.nqsqxd (mgr.14199) 1334 : cluster 0 pgmap v1135: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:27.202 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:28.507 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:28 smithi172 bash[24902]: cluster 2023-12-07T17:41:26.920266+0000 mgr.smithi172.nqsqxd (mgr.14199) 1335 : cluster 0 pgmap v1136: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:30.559 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:30.559 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:30.807 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:30 smithi172 bash[24902]: cluster 2023-12-07T17:41:28.920842+0000 mgr.smithi172.nqsqxd (mgr.14199) 1336 : cluster 0 pgmap v1137: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:31.387 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:31.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:31 smithi172 bash[24902]: audit 2023-12-07T17:41:30.546020+0000 mgr.smithi172.nqsqxd (mgr.14199) 1337 : audit 0 from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:32.387 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:32.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:32 smithi172 bash[24902]: cluster 2023-12-07T17:41:30.921529+0000 mgr.smithi172.nqsqxd (mgr.14199) 1338 : cluster 0 pgmap v1138: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:34.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:34 smithi172 bash[24902]: cluster 2023-12-07T17:41:32.922327+0000 mgr.smithi172.nqsqxd (mgr.14199) 1339 : cluster 0 pgmap v1139: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:34 smithi172 bash[24902]: audit 2023-12-07T17:41:34.127928+0000 mon.smithi172 (mon.0) 778 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:41:36.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:36 smithi172 bash[24902]: cluster 2023-12-07T17:41:34.923001+0000 mgr.smithi172.nqsqxd (mgr.14199) 1340 : cluster 0 pgmap v1140: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:37.191 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:38.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:38 smithi172 bash[24902]: cluster 2023-12-07T17:41:36.923843+0000 mgr.smithi172.nqsqxd (mgr.14199) 1341 : cluster 0 pgmap v1141: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:40.649 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:40.649 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:40.700 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:40 smithi172 bash[24902]: cluster 2023-12-07T17:41:38.924512+0000 mgr.smithi172.nqsqxd (mgr.14199) 1342 : cluster 0 pgmap v1142: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:41.511 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:42.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:42.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:42 smithi172 bash[24902]: audit 2023-12-07T17:41:40.637515+0000 mgr.smithi172.nqsqxd (mgr.14199) 1343 : audit 0 from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:42.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:42 smithi172 bash[24902]: cluster 2023-12-07T17:41:40.925222+0000 mgr.smithi172.nqsqxd (mgr.14199) 1344 : cluster 0 pgmap v1143: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:44.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:44 smithi172 bash[24902]: cluster 2023-12-07T17:41:42.926016+0000 mgr.smithi172.nqsqxd (mgr.14199) 1345 : cluster 0 pgmap v1144: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:46.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:46 smithi172 bash[24902]: cluster 2023-12-07T17:41:44.926710+0000 mgr.smithi172.nqsqxd (mgr.14199) 1346 : cluster 0 pgmap v1145: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:47.306 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:48.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:48 smithi172 bash[24902]: cluster 2023-12-07T17:41:46.927451+0000 mgr.smithi172.nqsqxd (mgr.14199) 1347 : cluster 0 pgmap v1146: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:49.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:49 smithi172 bash[24902]: audit 2023-12-07T17:41:49.128239+0000 mon.smithi172 (mon.0) 779 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:41:50.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:50 smithi172 bash[24902]: cluster 2023-12-07T17:41:48.928159+0000 mgr.smithi172.nqsqxd (mgr.14199) 1348 : cluster 0 pgmap v1147: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:50.807 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:41:50.807 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:41:51.712 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:41:52.714 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:41:52.727 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:52 smithi172 bash[24902]: audit 2023-12-07T17:41:50.794240+0000 mgr.smithi172.nqsqxd (mgr.14199) 1349 : audit 0 from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:41:52.727 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:52 smithi172 bash[24902]: cluster 2023-12-07T17:41:50.928681+0000 mgr.smithi172.nqsqxd (mgr.14199) 1350 : cluster 0 pgmap v1148: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:54.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:54 smithi172 bash[24902]: cluster 2023-12-07T17:41:52.929310+0000 mgr.smithi172.nqsqxd (mgr.14199) 1351 : cluster 0 pgmap v1149: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:56.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:56 smithi172 bash[24902]: cluster 2023-12-07T17:41:54.929908+0000 mgr.smithi172.nqsqxd (mgr.14199) 1352 : cluster 0 pgmap v1150: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:41:57.515 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:41:58.762 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:41:58 smithi172 bash[24902]: cluster 2023-12-07T17:41:56.930734+0000 mgr.smithi172.nqsqxd (mgr.14199) 1353 : cluster 0 pgmap v1151: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:00.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:00 smithi172 bash[24902]: cluster 2023-12-07T17:41:58.931311+0000 mgr.smithi172.nqsqxd (mgr.14199) 1354 : cluster 0 pgmap v1152: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:00.882 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:00.882 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:01.707 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:01.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:01 smithi172 bash[24902]: audit 2023-12-07T17:42:00.944875+0000 mon.smithi172 (mon.0) 780 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:42:02.708 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: audit 2023-12-07T17:42:00.868141+0000 mgr.smithi172.nqsqxd (mgr.14199) 1355 : audit 0 from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: cluster 2023-12-07T17:42:00.932006+0000 mgr.smithi172.nqsqxd (mgr.14199) 1356 : cluster 0 pgmap v1153: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: audit 2023-12-07T17:42:01.564730+0000 mon.smithi172 (mon.0) 781 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: audit 2023-12-07T17:42:01.566397+0000 mon.smithi172 (mon.0) 782 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: cluster 2023-12-07T17:42:01.569164+0000 mgr.smithi172.nqsqxd (mgr.14199) 1357 : cluster 0 pgmap v1154: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: cluster 2023-12-07T17:42:01.569741+0000 mgr.smithi172.nqsqxd (mgr.14199) 1358 : cluster 0 pgmap v1155: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:02.722 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:02 smithi172 bash[24902]: audit 2023-12-07T17:42:01.573001+0000 mon.smithi172 (mon.0) 783 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:42:04.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:03 smithi172 bash[24902]: cluster 2023-12-07T17:42:03.570433+0000 mgr.smithi172.nqsqxd (mgr.14199) 1359 : cluster 0 pgmap v1156: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:05.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:04 smithi172 bash[24902]: audit 2023-12-07T17:42:04.128618+0000 mon.smithi172 (mon.0) 784 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:42:06.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:05 smithi172 bash[24902]: cluster 2023-12-07T17:42:05.571062+0000 mgr.smithi172.nqsqxd (mgr.14199) 1360 : cluster 0 pgmap v1157: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:07.509 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:08.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:08 smithi172 bash[24902]: cluster 2023-12-07T17:42:07.571919+0000 mgr.smithi172.nqsqxd (mgr.14199) 1361 : cluster 0 pgmap v1158: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:09.878 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:09 smithi172 bash[24902]: cluster 2023-12-07T17:42:09.572601+0000 mgr.smithi172.nqsqxd (mgr.14199) 1362 : cluster 0 pgmap v1159: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:10.994 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:10.994 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:11.825 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:12.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:11 smithi172 bash[24902]: audit 2023-12-07T17:42:10.982134+0000 mgr.smithi172.nqsqxd (mgr.14199) 1363 : audit 0 from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:12.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:11 smithi172 bash[24902]: cluster 2023-12-07T17:42:11.573448+0000 mgr.smithi172.nqsqxd (mgr.14199) 1364 : cluster 0 pgmap v1160: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:12.826 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:14.018 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:13 smithi172 bash[24902]: cluster 2023-12-07T17:42:13.574105+0000 mgr.smithi172.nqsqxd (mgr.14199) 1365 : cluster 0 pgmap v1161: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:16.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:15 smithi172 bash[24902]: cluster 2023-12-07T17:42:15.574782+0000 mgr.smithi172.nqsqxd (mgr.14199) 1366 : cluster 0 pgmap v1162: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:17.616 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:18.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:18 smithi172 bash[24902]: cluster 2023-12-07T17:42:17.575661+0000 mgr.smithi172.nqsqxd (mgr.14199) 1367 : cluster 0 pgmap v1163: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:19.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:19 smithi172 bash[24902]: audit 2023-12-07T17:42:19.129146+0000 mon.smithi172 (mon.0) 785 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:42:20.484 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:20 smithi172 bash[24902]: cluster 2023-12-07T17:42:19.576351+0000 mgr.smithi172.nqsqxd (mgr.14199) 1368 : cluster 0 pgmap v1164: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:20.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:20.978 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:21.816 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:22.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:21 smithi172 bash[24902]: audit 2023-12-07T17:42:20.965788+0000 mgr.smithi172.nqsqxd (mgr.14199) 1369 : audit 0 from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:22.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:21 smithi172 bash[24902]: cluster 2023-12-07T17:42:21.577179+0000 mgr.smithi172.nqsqxd (mgr.14199) 1370 : cluster 0 pgmap v1165: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:22.816 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:24.128 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:23 smithi172 bash[24902]: cluster 2023-12-07T17:42:23.577857+0000 mgr.smithi172.nqsqxd (mgr.14199) 1371 : cluster 0 pgmap v1166: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:27.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:26 smithi172 bash[24902]: cluster 2023-12-07T17:42:25.578412+0000 mgr.smithi172.nqsqxd (mgr.14199) 1372 : cluster 0 pgmap v1167: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:27.614 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:29.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:29 smithi172 bash[24902]: cluster 2023-12-07T17:42:27.579222+0000 mgr.smithi172.nqsqxd (mgr.14199) 1373 : cluster 0 pgmap v1168: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:31.041 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:31.041 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:31.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:31 smithi172 bash[24902]: cluster 2023-12-07T17:42:29.579844+0000 mgr.smithi172.nqsqxd (mgr.14199) 1374 : cluster 0 pgmap v1169: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:31.878 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:32.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:32 smithi172 bash[24902]: audit 2023-12-07T17:42:31.029844+0000 mgr.smithi172.nqsqxd (mgr.14199) 1375 : audit 0 from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:32.878 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:33.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:33 smithi172 bash[24902]: cluster 2023-12-07T17:42:31.580607+0000 mgr.smithi172.nqsqxd (mgr.14199) 1376 : cluster 0 pgmap v1170: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:35.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:35 smithi172 bash[24902]: cluster 2023-12-07T17:42:33.581267+0000 mgr.smithi172.nqsqxd (mgr.14199) 1377 : cluster 0 pgmap v1171: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:35.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:35 smithi172 bash[24902]: audit 2023-12-07T17:42:34.129381+0000 mon.smithi172 (mon.0) 786 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:42:37.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:37 smithi172 bash[24902]: cluster 2023-12-07T17:42:35.581945+0000 mgr.smithi172.nqsqxd (mgr.14199) 1378 : cluster 0 pgmap v1172: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:37.671 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:39.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:39 smithi172 bash[24902]: cluster 2023-12-07T17:42:37.582772+0000 mgr.smithi172.nqsqxd (mgr.14199) 1379 : cluster 0 pgmap v1173: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:41.113 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:41.114 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:41.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:41 smithi172 bash[24902]: cluster 2023-12-07T17:42:39.583355+0000 mgr.smithi172.nqsqxd (mgr.14199) 1380 : cluster 0 pgmap v1174: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:41.960 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:42.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:42 smithi172 bash[24902]: audit 2023-12-07T17:42:41.103835+0000 mgr.smithi172.nqsqxd (mgr.14199) 1381 : audit 0 from='client.14892 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:42.962 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:43.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:43 smithi172 bash[24902]: cluster 2023-12-07T17:42:41.584153+0000 mgr.smithi172.nqsqxd (mgr.14199) 1382 : cluster 0 pgmap v1175: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:45.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:45 smithi172 bash[24902]: cluster 2023-12-07T17:42:43.584787+0000 mgr.smithi172.nqsqxd (mgr.14199) 1383 : cluster 0 pgmap v1176: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:47.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:47 smithi172 bash[24902]: cluster 2023-12-07T17:42:45.585410+0000 mgr.smithi172.nqsqxd (mgr.14199) 1384 : cluster 0 pgmap v1177: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:47.754 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:49.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:49 smithi172 bash[24902]: cluster 2023-12-07T17:42:47.586234+0000 mgr.smithi172.nqsqxd (mgr.14199) 1385 : cluster 0 pgmap v1178: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:50.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:50 smithi172 bash[24902]: audit 2023-12-07T17:42:49.129783+0000 mon.smithi172 (mon.0) 787 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:42:51.150 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:42:51.151 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:42:51.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:51 smithi172 bash[24902]: cluster 2023-12-07T17:42:49.586890+0000 mgr.smithi172.nqsqxd (mgr.14199) 1386 : cluster 0 pgmap v1179: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:51.952 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:42:52.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:52 smithi172 bash[24902]: audit 2023-12-07T17:42:51.140061+0000 mgr.smithi172.nqsqxd (mgr.14199) 1387 : audit 0 from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:42:52.954 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:42:53.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:53 smithi172 bash[24902]: cluster 2023-12-07T17:42:51.587440+0000 mgr.smithi172.nqsqxd (mgr.14199) 1388 : cluster 0 pgmap v1180: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:55.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:55 smithi172 bash[24902]: cluster 2023-12-07T17:42:53.588156+0000 mgr.smithi172.nqsqxd (mgr.14199) 1389 : cluster 0 pgmap v1181: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:57.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:57 smithi172 bash[24902]: cluster 2023-12-07T17:42:55.588861+0000 mgr.smithi172.nqsqxd (mgr.14199) 1390 : cluster 0 pgmap v1182: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:42:57.747 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:42:59.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:42:59 smithi172 bash[24902]: cluster 2023-12-07T17:42:57.589733+0000 mgr.smithi172.nqsqxd (mgr.14199) 1391 : cluster 0 pgmap v1183: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:01.115 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:01.115 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:01.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:01 smithi172 bash[24902]: cluster 2023-12-07T17:42:59.590317+0000 mgr.smithi172.nqsqxd (mgr.14199) 1392 : cluster 0 pgmap v1184: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:01.917 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:02.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:02 smithi172 bash[24902]: audit 2023-12-07T17:43:01.101235+0000 mgr.smithi172.nqsqxd (mgr.14199) 1393 : audit 0 from='client.14896 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:02.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:02 smithi172 bash[24902]: audit 2023-12-07T17:43:01.624683+0000 mon.smithi172 (mon.0) 788 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:43:02.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: cluster 2023-12-07T17:43:01.591086+0000 mgr.smithi172.nqsqxd (mgr.14199) 1394 : cluster 0 pgmap v1185: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: audit 2023-12-07T17:43:02.195371+0000 mon.smithi172 (mon.0) 789 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: audit 2023-12-07T17:43:02.197280+0000 mon.smithi172 (mon.0) 790 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: cluster 2023-12-07T17:43:02.200277+0000 mgr.smithi172.nqsqxd (mgr.14199) 1395 : cluster 0 pgmap v1186: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: cluster 2023-12-07T17:43:02.200855+0000 mgr.smithi172.nqsqxd (mgr.14199) 1396 : cluster 0 pgmap v1187: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:03.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:03 smithi172 bash[24902]: audit 2023-12-07T17:43:02.205846+0000 mon.smithi172 (mon.0) 791 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:43:04.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:04 smithi172 bash[24902]: audit 2023-12-07T17:43:04.129845+0000 mon.smithi172 (mon.0) 792 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:43:05.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:05 smithi172 bash[24902]: cluster 2023-12-07T17:43:04.201487+0000 mgr.smithi172.nqsqxd (mgr.14199) 1397 : cluster 0 pgmap v1188: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:07.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:07 smithi172 bash[24902]: cluster 2023-12-07T17:43:06.202191+0000 mgr.smithi172.nqsqxd (mgr.14199) 1398 : cluster 0 pgmap v1189: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:07.713 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:09.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:09 smithi172 bash[24902]: cluster 2023-12-07T17:43:08.202883+0000 mgr.smithi172.nqsqxd (mgr.14199) 1399 : cluster 0 pgmap v1190: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:11.056 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:11.056 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:11 smithi172 bash[24902]: cluster 2023-12-07T17:43:10.203527+0000 mgr.smithi172.nqsqxd (mgr.14199) 1400 : cluster 0 pgmap v1191: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:11.889 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:12 smithi172 bash[24902]: audit 2023-12-07T17:43:11.048159+0000 mgr.smithi172.nqsqxd (mgr.14199) 1401 : audit 0 from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:12.891 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:13.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:13 smithi172 bash[24902]: cluster 2023-12-07T17:43:12.204360+0000 mgr.smithi172.nqsqxd (mgr.14199) 1402 : cluster 0 pgmap v1192: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:15.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:15 smithi172 bash[24902]: cluster 2023-12-07T17:43:14.205044+0000 mgr.smithi172.nqsqxd (mgr.14199) 1403 : cluster 0 pgmap v1193: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:17.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:17 smithi172 bash[24902]: cluster 2023-12-07T17:43:16.205901+0000 mgr.smithi172.nqsqxd (mgr.14199) 1404 : cluster 0 pgmap v1194: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:17.678 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:19 smithi172 bash[24902]: cluster 2023-12-07T17:43:18.206609+0000 mgr.smithi172.nqsqxd (mgr.14199) 1405 : cluster 0 pgmap v1195: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:19 smithi172 bash[24902]: audit 2023-12-07T17:43:19.130833+0000 mon.smithi172 (mon.0) 793 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:43:21.200 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:21.201 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:21.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:21 smithi172 bash[24902]: cluster 2023-12-07T17:43:20.207261+0000 mgr.smithi172.nqsqxd (mgr.14199) 1406 : cluster 0 pgmap v1196: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:22.060 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:22.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:22 smithi172 bash[24902]: audit 2023-12-07T17:43:21.187783+0000 mgr.smithi172.nqsqxd (mgr.14199) 1407 : audit 0 from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:23.061 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:23.378 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:23 smithi172 bash[24902]: cluster 2023-12-07T17:43:22.208125+0000 mgr.smithi172.nqsqxd (mgr.14199) 1408 : cluster 0 pgmap v1197: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:25.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:25 smithi172 bash[24902]: cluster 2023-12-07T17:43:24.208784+0000 mgr.smithi172.nqsqxd (mgr.14199) 1409 : cluster 0 pgmap v1198: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:27.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:27 smithi172 bash[24902]: cluster 2023-12-07T17:43:26.209539+0000 mgr.smithi172.nqsqxd (mgr.14199) 1410 : cluster 0 pgmap v1199: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:27.858 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:29.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:29 smithi172 bash[24902]: cluster 2023-12-07T17:43:28.210213+0000 mgr.smithi172.nqsqxd (mgr.14199) 1411 : cluster 0 pgmap v1200: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:31.211 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:31.211 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:31.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:31 smithi172 bash[24902]: cluster 2023-12-07T17:43:30.210917+0000 mgr.smithi172.nqsqxd (mgr.14199) 1412 : cluster 0 pgmap v1201: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:32.033 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:32.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:32 smithi172 bash[24902]: audit 2023-12-07T17:43:31.197519+0000 mgr.smithi172.nqsqxd (mgr.14199) 1413 : audit 0 from='client.14902 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:33.034 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:33.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:33 smithi172 bash[24902]: cluster 2023-12-07T17:43:32.211760+0000 mgr.smithi172.nqsqxd (mgr.14199) 1414 : cluster 0 pgmap v1202: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:34.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:34 smithi172 bash[24902]: audit 2023-12-07T17:43:34.131201+0000 mon.smithi172 (mon.0) 794 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:43:35.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:35 smithi172 bash[24902]: cluster 2023-12-07T17:43:34.212399+0000 mgr.smithi172.nqsqxd (mgr.14199) 1415 : cluster 0 pgmap v1203: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:37.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:37 smithi172 bash[24902]: cluster 2023-12-07T17:43:36.213179+0000 mgr.smithi172.nqsqxd (mgr.14199) 1416 : cluster 0 pgmap v1204: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:37.828 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:39.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:39 smithi172 bash[24902]: cluster 2023-12-07T17:43:38.213781+0000 mgr.smithi172.nqsqxd (mgr.14199) 1417 : cluster 0 pgmap v1205: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:41.120 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:41.120 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:41.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:41 smithi172 bash[24902]: cluster 2023-12-07T17:43:40.214453+0000 mgr.smithi172.nqsqxd (mgr.14199) 1418 : cluster 0 pgmap v1206: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:41.971 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:42.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:42 smithi172 bash[24902]: audit 2023-12-07T17:43:41.105105+0000 mgr.smithi172.nqsqxd (mgr.14199) 1419 : audit 0 from='client.14904 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:42.972 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:43.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:43 smithi172 bash[24902]: cluster 2023-12-07T17:43:42.215329+0000 mgr.smithi172.nqsqxd (mgr.14199) 1420 : cluster 0 pgmap v1207: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:45.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:45 smithi172 bash[24902]: cluster 2023-12-07T17:43:44.215954+0000 mgr.smithi172.nqsqxd (mgr.14199) 1421 : cluster 0 pgmap v1208: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:47.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:47 smithi172 bash[24902]: cluster 2023-12-07T17:43:46.216814+0000 mgr.smithi172.nqsqxd (mgr.14199) 1422 : cluster 0 pgmap v1209: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:47.759 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:49.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:49 smithi172 bash[24902]: cluster 2023-12-07T17:43:48.217481+0000 mgr.smithi172.nqsqxd (mgr.14199) 1423 : cluster 0 pgmap v1210: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:49.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:49 smithi172 bash[24902]: audit 2023-12-07T17:43:49.131844+0000 mon.smithi172 (mon.0) 795 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:43:51.203 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:43:51.203 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:43:51.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:51 smithi172 bash[24902]: cluster 2023-12-07T17:43:50.218001+0000 mgr.smithi172.nqsqxd (mgr.14199) 1424 : cluster 0 pgmap v1211: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:52.042 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:43:52.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:52 smithi172 bash[24902]: audit 2023-12-07T17:43:51.188328+0000 mgr.smithi172.nqsqxd (mgr.14199) 1425 : audit 0 from='client.14906 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:43:53.043 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:43:53.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:53 smithi172 bash[24902]: cluster 2023-12-07T17:43:52.218833+0000 mgr.smithi172.nqsqxd (mgr.14199) 1426 : cluster 0 pgmap v1212: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:55.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:55 smithi172 bash[24902]: cluster 2023-12-07T17:43:54.219499+0000 mgr.smithi172.nqsqxd (mgr.14199) 1427 : cluster 0 pgmap v1213: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:57.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:57 smithi172 bash[24902]: cluster 2023-12-07T17:43:56.220325+0000 mgr.smithi172.nqsqxd (mgr.14199) 1428 : cluster 0 pgmap v1214: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:43:57.847 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:43:59.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:43:59 smithi172 bash[24902]: cluster 2023-12-07T17:43:58.221009+0000 mgr.smithi172.nqsqxd (mgr.14199) 1429 : cluster 0 pgmap v1215: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:01.225 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:01.226 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:01.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:01 smithi172 bash[24902]: cluster 2023-12-07T17:44:00.221714+0000 mgr.smithi172.nqsqxd (mgr.14199) 1430 : cluster 0 pgmap v1216: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:01.996 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:02.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:02 smithi172 bash[24902]: audit 2023-12-07T17:44:01.212959+0000 mgr.smithi172.nqsqxd (mgr.14199) 1431 : audit 0 from='client.14908 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:02.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:02 smithi172 bash[24902]: audit 2023-12-07T17:44:02.256188+0000 mon.smithi172 (mon.0) 796 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:44:02.998 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:03 smithi172 bash[24902]: cluster 2023-12-07T17:44:02.222602+0000 mgr.smithi172.nqsqxd (mgr.14199) 1432 : cluster 0 pgmap v1217: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:03 smithi172 bash[24902]: audit 2023-12-07T17:44:02.880278+0000 mon.smithi172 (mon.0) 797 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:44:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:03 smithi172 bash[24902]: audit 2023-12-07T17:44:02.882214+0000 mon.smithi172 (mon.0) 798 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:44:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:03 smithi172 bash[24902]: audit 2023-12-07T17:44:02.892012+0000 mon.smithi172 (mon.0) 799 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:44:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:04 smithi172 bash[24902]: cluster 2023-12-07T17:44:02.885127+0000 mgr.smithi172.nqsqxd (mgr.14199) 1433 : cluster 0 pgmap v1218: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:04 smithi172 bash[24902]: cluster 2023-12-07T17:44:02.885584+0000 mgr.smithi172.nqsqxd (mgr.14199) 1434 : cluster 0 pgmap v1219: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:04 smithi172 bash[24902]: audit 2023-12-07T17:44:04.132132+0000 mon.smithi172 (mon.0) 800 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:44:06.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:06 smithi172 bash[24902]: cluster 2023-12-07T17:44:04.886189+0000 mgr.smithi172.nqsqxd (mgr.14199) 1435 : cluster 0 pgmap v1220: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:07.788 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:08.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:08 smithi172 bash[24902]: cluster 2023-12-07T17:44:06.887077+0000 mgr.smithi172.nqsqxd (mgr.14199) 1436 : cluster 0 pgmap v1221: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:10.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:10 smithi172 bash[24902]: cluster 2023-12-07T17:44:08.887519+0000 mgr.smithi172.nqsqxd (mgr.14199) 1437 : cluster 0 pgmap v1222: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:11.129 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:11.129 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:11.962 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:12 smithi172 bash[24902]: cluster 2023-12-07T17:44:10.887981+0000 mgr.smithi172.nqsqxd (mgr.14199) 1438 : cluster 0 pgmap v1223: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:12 smithi172 bash[24902]: audit 2023-12-07T17:44:11.120129+0000 mgr.smithi172.nqsqxd (mgr.14199) 1439 : audit 0 from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:12.963 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:14.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:14 smithi172 bash[24902]: cluster 2023-12-07T17:44:12.888763+0000 mgr.smithi172.nqsqxd (mgr.14199) 1440 : cluster 0 pgmap v1224: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:16.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:16 smithi172 bash[24902]: cluster 2023-12-07T17:44:14.889400+0000 mgr.smithi172.nqsqxd (mgr.14199) 1441 : cluster 0 pgmap v1225: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:17.758 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:18.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:18 smithi172 bash[24902]: cluster 2023-12-07T17:44:16.890244+0000 mgr.smithi172.nqsqxd (mgr.14199) 1442 : cluster 0 pgmap v1226: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:19 smithi172 bash[24902]: audit 2023-12-07T17:44:19.132659+0000 mon.smithi172 (mon.0) 801 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:44:20.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:20 smithi172 bash[24902]: cluster 2023-12-07T17:44:18.890878+0000 mgr.smithi172.nqsqxd (mgr.14199) 1443 : cluster 0 pgmap v1227: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:21.166 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:21.167 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:22.011 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:22.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:22 smithi172 bash[24902]: cluster 2023-12-07T17:44:20.891330+0000 mgr.smithi172.nqsqxd (mgr.14199) 1444 : cluster 0 pgmap v1228: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:22.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:22 smithi172 bash[24902]: audit 2023-12-07T17:44:21.154175+0000 mgr.smithi172.nqsqxd (mgr.14199) 1445 : audit 0 from='client.14912 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:23.012 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:24.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:24 smithi172 bash[24902]: cluster 2023-12-07T17:44:22.892110+0000 mgr.smithi172.nqsqxd (mgr.14199) 1446 : cluster 0 pgmap v1229: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:26.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:26 smithi172 bash[24902]: cluster 2023-12-07T17:44:24.892768+0000 mgr.smithi172.nqsqxd (mgr.14199) 1447 : cluster 0 pgmap v1230: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:27.806 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:28.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:28 smithi172 bash[24902]: cluster 2023-12-07T17:44:26.893639+0000 mgr.smithi172.nqsqxd (mgr.14199) 1448 : cluster 0 pgmap v1231: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:30.680 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:30 smithi172 bash[24902]: cluster 2023-12-07T17:44:28.894297+0000 mgr.smithi172.nqsqxd (mgr.14199) 1449 : cluster 0 pgmap v1232: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:31.090 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:31.091 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:31.899 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:32 smithi172 bash[24902]: cluster 2023-12-07T17:44:30.895014+0000 mgr.smithi172.nqsqxd (mgr.14199) 1450 : cluster 0 pgmap v1233: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:32 smithi172 bash[24902]: audit 2023-12-07T17:44:31.075184+0000 mgr.smithi172.nqsqxd (mgr.14199) 1451 : audit 0 from='client.14914 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:32.899 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:34 smithi172 bash[24902]: cluster 2023-12-07T17:44:32.895836+0000 mgr.smithi172.nqsqxd (mgr.14199) 1452 : cluster 0 pgmap v1234: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:34 smithi172 bash[24902]: audit 2023-12-07T17:44:34.132357+0000 mon.smithi172 (mon.0) 802 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:44:36.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:36 smithi172 bash[24902]: cluster 2023-12-07T17:44:34.896507+0000 mgr.smithi172.nqsqxd (mgr.14199) 1453 : cluster 0 pgmap v1235: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:37.696 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:38.659 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:38 smithi172 bash[24902]: cluster 2023-12-07T17:44:36.897360+0000 mgr.smithi172.nqsqxd (mgr.14199) 1454 : cluster 0 pgmap v1236: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:40.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:40 smithi172 bash[24902]: cluster 2023-12-07T17:44:38.898118+0000 mgr.smithi172.nqsqxd (mgr.14199) 1455 : cluster 0 pgmap v1237: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:40.799 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:40.799 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:41.706 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:42.707 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:42.721 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:42 smithi172 bash[24902]: audit 2023-12-07T17:44:40.784738+0000 mgr.smithi172.nqsqxd (mgr.14199) 1456 : audit 0 from='client.14916 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:42.721 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:42 smithi172 bash[24902]: cluster 2023-12-07T17:44:40.898886+0000 mgr.smithi172.nqsqxd (mgr.14199) 1457 : cluster 0 pgmap v1238: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:44.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:44 smithi172 bash[24902]: cluster 2023-12-07T17:44:42.899414+0000 mgr.smithi172.nqsqxd (mgr.14199) 1458 : cluster 0 pgmap v1239: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:46.791 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:46 smithi172 bash[24902]: cluster 2023-12-07T17:44:44.900131+0000 mgr.smithi172.nqsqxd (mgr.14199) 1459 : cluster 0 pgmap v1240: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:47.504 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:48.736 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:48 smithi172 bash[24902]: cluster 2023-12-07T17:44:46.901006+0000 mgr.smithi172.nqsqxd (mgr.14199) 1460 : cluster 0 pgmap v1241: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:49 smithi172 bash[24902]: audit 2023-12-07T17:44:49.132669+0000 mon.smithi172 (mon.0) 803 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:44:50.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:50 smithi172 bash[24902]: cluster 2023-12-07T17:44:48.901556+0000 mgr.smithi172.nqsqxd (mgr.14199) 1461 : cluster 0 pgmap v1242: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:50.948 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:44:50.949 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:44:51.780 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:44:52.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:44:52.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:52 smithi172 bash[24902]: cluster 2023-12-07T17:44:50.902107+0000 mgr.smithi172.nqsqxd (mgr.14199) 1462 : cluster 0 pgmap v1243: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:52.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:52 smithi172 bash[24902]: audit 2023-12-07T17:44:50.935773+0000 mgr.smithi172.nqsqxd (mgr.14199) 1463 : audit 0 from='client.14918 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:44:54.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:54 smithi172 bash[24902]: cluster 2023-12-07T17:44:52.902963+0000 mgr.smithi172.nqsqxd (mgr.14199) 1464 : cluster 0 pgmap v1244: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:56.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:56 smithi172 bash[24902]: cluster 2023-12-07T17:44:54.903592+0000 mgr.smithi172.nqsqxd (mgr.14199) 1465 : cluster 0 pgmap v1245: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:44:57.580 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:44:58.753 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:44:58 smithi172 bash[24902]: cluster 2023-12-07T17:44:56.904432+0000 mgr.smithi172.nqsqxd (mgr.14199) 1466 : cluster 0 pgmap v1246: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:00.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:00 smithi172 bash[24902]: cluster 2023-12-07T17:44:58.905088+0000 mgr.smithi172.nqsqxd (mgr.14199) 1467 : cluster 0 pgmap v1247: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:00.904 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:00.904 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:01.698 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:02.699 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:02.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:02 smithi172 bash[24902]: audit 2023-12-07T17:45:00.890692+0000 mgr.smithi172.nqsqxd (mgr.14199) 1468 : audit 0 from='client.14920 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:02.710 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:02 smithi172 bash[24902]: cluster 2023-12-07T17:45:00.905739+0000 mgr.smithi172.nqsqxd (mgr.14199) 1469 : cluster 0 pgmap v1248: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:03.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:03 smithi172 bash[24902]: audit 2023-12-07T17:45:02.942863+0000 mon.smithi172 (mon.0) 804 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: cluster 2023-12-07T17:45:02.906507+0000 mgr.smithi172.nqsqxd (mgr.14199) 1470 : cluster 0 pgmap v1249: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:03.468409+0000 mon.smithi172 (mon.0) 805 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:03.477384+0000 mon.smithi172 (mon.0) 806 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:04.049709+0000 mon.smithi172 (mon.0) 807 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:04.051101+0000 mon.smithi172 (mon.0) 808 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:04.059137+0000 mon.smithi172 (mon.0) 809 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:45:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:04 smithi172 bash[24902]: audit 2023-12-07T17:45:04.133645+0000 mon.smithi172 (mon.0) 810 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:45:05.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:05 smithi172 bash[24902]: cluster 2023-12-07T17:45:04.053404+0000 mgr.smithi172.nqsqxd (mgr.14199) 1471 : cluster 0 pgmap v1250: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:05.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:05 smithi172 bash[24902]: cluster 2023-12-07T17:45:04.053900+0000 mgr.smithi172.nqsqxd (mgr.14199) 1472 : cluster 0 pgmap v1251: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:07.497 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:07.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:07 smithi172 bash[24902]: cluster 2023-12-07T17:45:06.054640+0000 mgr.smithi172.nqsqxd (mgr.14199) 1473 : cluster 0 pgmap v1252: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:09.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:09 smithi172 bash[24902]: cluster 2023-12-07T17:45:08.055407+0000 mgr.smithi172.nqsqxd (mgr.14199) 1474 : cluster 0 pgmap v1253: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:10.935 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:10.935 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:11.761 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:11 smithi172 bash[24902]: cluster 2023-12-07T17:45:10.056076+0000 mgr.smithi172.nqsqxd (mgr.14199) 1475 : cluster 0 pgmap v1254: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:11.763 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:12 smithi172 bash[24902]: audit 2023-12-07T17:45:10.923162+0000 mgr.smithi172.nqsqxd (mgr.14199) 1476 : audit 0 from='client.14922 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:12.764 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:13 smithi172 bash[24902]: cluster 2023-12-07T17:45:12.056886+0000 mgr.smithi172.nqsqxd (mgr.14199) 1477 : cluster 0 pgmap v1255: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:15.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:15 smithi172 bash[24902]: cluster 2023-12-07T17:45:14.057529+0000 mgr.smithi172.nqsqxd (mgr.14199) 1478 : cluster 0 pgmap v1256: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:17.564 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:17.596 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:17 smithi172 bash[24902]: cluster 2023-12-07T17:45:16.058282+0000 mgr.smithi172.nqsqxd (mgr.14199) 1479 : cluster 0 pgmap v1257: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:19.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:19 smithi172 bash[24902]: cluster 2023-12-07T17:45:18.059165+0000 mgr.smithi172.nqsqxd (mgr.14199) 1480 : cluster 0 pgmap v1258: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:19.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:19 smithi172 bash[24902]: audit 2023-12-07T17:45:19.133601+0000 mon.smithi172 (mon.0) 811 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:45:20.968 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:20.969 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:21.767 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:21 smithi172 bash[24902]: cluster 2023-12-07T17:45:20.059861+0000 mgr.smithi172.nqsqxd (mgr.14199) 1481 : cluster 0 pgmap v1259: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:21.769 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:22.770 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:22.783 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:22 smithi172 bash[24902]: audit 2023-12-07T17:45:20.955406+0000 mgr.smithi172.nqsqxd (mgr.14199) 1482 : audit 0 from='client.14924 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:23.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:23 smithi172 bash[24902]: cluster 2023-12-07T17:45:22.060658+0000 mgr.smithi172.nqsqxd (mgr.14199) 1483 : cluster 0 pgmap v1260: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:25.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:25 smithi172 bash[24902]: cluster 2023-12-07T17:45:24.061229+0000 mgr.smithi172.nqsqxd (mgr.14199) 1484 : cluster 0 pgmap v1261: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:27.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:27 smithi172 bash[24902]: cluster 2023-12-07T17:45:26.061955+0000 mgr.smithi172.nqsqxd (mgr.14199) 1485 : cluster 0 pgmap v1262: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:27.565 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:29.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:29 smithi172 bash[24902]: cluster 2023-12-07T17:45:28.062679+0000 mgr.smithi172.nqsqxd (mgr.14199) 1486 : cluster 0 pgmap v1263: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:30.841 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:30.841 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:31.679 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:31.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:31 smithi172 bash[24902]: cluster 2023-12-07T17:45:30.063275+0000 mgr.smithi172.nqsqxd (mgr.14199) 1487 : cluster 0 pgmap v1264: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:32.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:32 smithi172 bash[24902]: audit 2023-12-07T17:45:30.828480+0000 mgr.smithi172.nqsqxd (mgr.14199) 1488 : audit 0 from='client.14926 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:33.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:33 smithi172 bash[24902]: cluster 2023-12-07T17:45:32.064108+0000 mgr.smithi172.nqsqxd (mgr.14199) 1489 : cluster 0 pgmap v1265: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:34 smithi172 bash[24902]: audit 2023-12-07T17:45:34.134303+0000 mon.smithi172 (mon.0) 812 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:45:35.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:35 smithi172 bash[24902]: cluster 2023-12-07T17:45:34.064762+0000 mgr.smithi172.nqsqxd (mgr.14199) 1490 : cluster 0 pgmap v1266: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:37.484 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:37.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:37 smithi172 bash[24902]: cluster 2023-12-07T17:45:36.065552+0000 mgr.smithi172.nqsqxd (mgr.14199) 1491 : cluster 0 pgmap v1267: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:39.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:39 smithi172 bash[24902]: cluster 2023-12-07T17:45:38.066379+0000 mgr.smithi172.nqsqxd (mgr.14199) 1492 : cluster 0 pgmap v1268: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:40.971 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:40.971 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:41 smithi172 bash[24902]: cluster 2023-12-07T17:45:40.067069+0000 mgr.smithi172.nqsqxd (mgr.14199) 1493 : cluster 0 pgmap v1269: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:41.881 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:42.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:42 smithi172 bash[24902]: audit 2023-12-07T17:45:40.956976+0000 mgr.smithi172.nqsqxd (mgr.14199) 1494 : audit 0 from='client.14928 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:42.882 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:43.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:43 smithi172 bash[24902]: cluster 2023-12-07T17:45:42.067937+0000 mgr.smithi172.nqsqxd (mgr.14199) 1495 : cluster 0 pgmap v1270: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:45.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:45 smithi172 bash[24902]: cluster 2023-12-07T17:45:44.068640+0000 mgr.smithi172.nqsqxd (mgr.14199) 1496 : cluster 0 pgmap v1271: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:47.678 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:47.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:47 smithi172 bash[24902]: cluster 2023-12-07T17:45:46.069404+0000 mgr.smithi172.nqsqxd (mgr.14199) 1497 : cluster 0 pgmap v1272: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:49 smithi172 bash[24902]: cluster 2023-12-07T17:45:48.070192+0000 mgr.smithi172.nqsqxd (mgr.14199) 1498 : cluster 0 pgmap v1273: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:49 smithi172 bash[24902]: audit 2023-12-07T17:45:49.133946+0000 mon.smithi172 (mon.0) 813 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:45:51.064 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:45:51.064 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:45:51.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:51 smithi172 bash[24902]: cluster 2023-12-07T17:45:50.070864+0000 mgr.smithi172.nqsqxd (mgr.14199) 1499 : cluster 0 pgmap v1274: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:51.837 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:45:52.838 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:45:52.851 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:52 smithi172 bash[24902]: audit 2023-12-07T17:45:51.050610+0000 mgr.smithi172.nqsqxd (mgr.14199) 1500 : audit 0 from='client.14930 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:45:53.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:53 smithi172 bash[24902]: cluster 2023-12-07T17:45:52.071705+0000 mgr.smithi172.nqsqxd (mgr.14199) 1501 : cluster 0 pgmap v1275: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:55.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:55 smithi172 bash[24902]: cluster 2023-12-07T17:45:54.072344+0000 mgr.smithi172.nqsqxd (mgr.14199) 1502 : cluster 0 pgmap v1276: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:57.631 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:45:57.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:57 smithi172 bash[24902]: cluster 2023-12-07T17:45:56.073075+0000 mgr.smithi172.nqsqxd (mgr.14199) 1503 : cluster 0 pgmap v1277: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:45:59.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:45:59 smithi172 bash[24902]: cluster 2023-12-07T17:45:58.073655+0000 mgr.smithi172.nqsqxd (mgr.14199) 1504 : cluster 0 pgmap v1278: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:00.827 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:00.827 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:35:44.866591Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:35:44.866221Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:35:44.866338Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:35:44.866707Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:35:44.866092Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:35:44.865949Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:35:44.866469Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:35:44.867054Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:35:44.866939Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:35:44.867477Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:01.600 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:01.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:01 smithi172 bash[24902]: cluster 2023-12-07T17:46:00.074368+0000 mgr.smithi172.nqsqxd (mgr.14199) 1505 : cluster 0 pgmap v1279: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:02.601 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:02.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:02 smithi172 bash[24902]: audit 2023-12-07T17:46:00.815282+0000 mgr.smithi172.nqsqxd (mgr.14199) 1506 : audit 0 from='client.14932 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:03.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:03 smithi172 bash[24902]: cluster 2023-12-07T17:46:02.075246+0000 mgr.smithi172.nqsqxd (mgr.14199) 1507 : cluster 0 pgmap v1280: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:04 smithi172 bash[24902]: audit 2023-12-07T17:46:04.109866+0000 mon.smithi172 (mon.0) 814 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:46:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:04 smithi172 bash[24902]: audit 2023-12-07T17:46:04.134987+0000 mon.smithi172 (mon.0) 815 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:46:05.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:05 smithi172 bash[24902]: cluster 2023-12-07T17:46:04.075887+0000 mgr.smithi172.nqsqxd (mgr.14199) 1508 : cluster 0 pgmap v1281: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:07.404 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:07.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:07 smithi172 bash[24902]: cluster 2023-12-07T17:46:06.076610+0000 mgr.smithi172.nqsqxd (mgr.14199) 1509 : cluster 0 pgmap v1282: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:09.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:09 smithi172 bash[24902]: cluster 2023-12-07T17:46:08.077441+0000 mgr.smithi172.nqsqxd (mgr.14199) 1510 : cluster 0 pgmap v1283: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:10.830 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:10.830 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: cluster 2023-12-07T17:46:10.078122+0000 mgr.smithi172.nqsqxd (mgr.14199) 1511 : cluster 0 pgmap v1284: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: audit 2023-12-07T17:46:10.306046+0000 mon.smithi172 (mon.0) 816 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: audit 2023-12-07T17:46:10.314092+0000 mon.smithi172 (mon.0) 817 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: audit 2023-12-07T17:46:10.936296+0000 mon.smithi172 (mon.0) 818 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: audit 2023-12-07T17:46:10.937634+0000 mon.smithi172 (mon.0) 819 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:46:11.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:11 smithi172 bash[24902]: audit 2023-12-07T17:46:10.945925+0000 mon.smithi172 (mon.0) 820 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:46:11.641 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:12.642 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:12.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:12 smithi172 bash[24902]: audit 2023-12-07T17:46:10.818020+0000 mgr.smithi172.nqsqxd (mgr.14199) 1512 : audit 0 from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:12.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:12 smithi172 bash[24902]: cluster 2023-12-07T17:46:10.939638+0000 mgr.smithi172.nqsqxd (mgr.14199) 1513 : cluster 0 pgmap v1285: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:12.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:12 smithi172 bash[24902]: cluster 2023-12-07T17:46:10.940124+0000 mgr.smithi172.nqsqxd (mgr.14199) 1514 : cluster 0 pgmap v1286: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:14.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:14 smithi172 bash[24902]: cluster 2023-12-07T17:46:12.940868+0000 mgr.smithi172.nqsqxd (mgr.14199) 1515 : cluster 0 pgmap v1287: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:16.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:16 smithi172 bash[24902]: cluster 2023-12-07T17:46:14.941513+0000 mgr.smithi172.nqsqxd (mgr.14199) 1516 : cluster 0 pgmap v1288: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:17.436 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:18.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:18 smithi172 bash[24902]: cluster 2023-12-07T17:46:16.942339+0000 mgr.smithi172.nqsqxd (mgr.14199) 1517 : cluster 0 pgmap v1289: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:19.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:19 smithi172 bash[24902]: audit 2023-12-07T17:46:19.135398+0000 mon.smithi172 (mon.0) 821 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:46:20.732 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:20.732 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:20.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:20 smithi172 bash[24902]: cluster 2023-12-07T17:46:18.943025+0000 mgr.smithi172.nqsqxd (mgr.14199) 1518 : cluster 0 pgmap v1290: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:21.607 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:22.608 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:22.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:22 smithi172 bash[24902]: audit 2023-12-07T17:46:20.718344+0000 mgr.smithi172.nqsqxd (mgr.14199) 1519 : audit 0 from='client.14936 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:22.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:22 smithi172 bash[24902]: cluster 2023-12-07T17:46:20.943698+0000 mgr.smithi172.nqsqxd (mgr.14199) 1520 : cluster 0 pgmap v1291: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:24.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:24 smithi172 bash[24902]: cluster 2023-12-07T17:46:22.944494+0000 mgr.smithi172.nqsqxd (mgr.14199) 1521 : cluster 0 pgmap v1292: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:26.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:26 smithi172 bash[24902]: cluster 2023-12-07T17:46:24.945130+0000 mgr.smithi172.nqsqxd (mgr.14199) 1522 : cluster 0 pgmap v1293: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:27.411 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:28.798 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:28 smithi172 bash[24902]: cluster 2023-12-07T17:46:26.945869+0000 mgr.smithi172.nqsqxd (mgr.14199) 1523 : cluster 0 pgmap v1294: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:30.734 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:30.735 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:30.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:30 smithi172 bash[24902]: cluster 2023-12-07T17:46:28.946569+0000 mgr.smithi172.nqsqxd (mgr.14199) 1524 : cluster 0 pgmap v1295: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:31.607 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:32.608 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:32 smithi172 bash[24902]: audit 2023-12-07T17:46:30.720909+0000 mgr.smithi172.nqsqxd (mgr.14199) 1525 : audit 0 from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:32 smithi172 bash[24902]: cluster 2023-12-07T17:46:30.947194+0000 mgr.smithi172.nqsqxd (mgr.14199) 1526 : cluster 0 pgmap v1296: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:34.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:33 smithi172 bash[24902]: cluster 2023-12-07T17:46:32.948016+0000 mgr.smithi172.nqsqxd (mgr.14199) 1527 : cluster 0 pgmap v1297: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:35.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:34 smithi172 bash[24902]: audit 2023-12-07T17:46:34.135938+0000 mon.smithi172 (mon.0) 822 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:46:36.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:35 smithi172 bash[24902]: cluster 2023-12-07T17:46:34.948629+0000 mgr.smithi172.nqsqxd (mgr.14199) 1528 : cluster 0 pgmap v1298: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:37.404 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:38.479 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:38 smithi172 bash[24902]: cluster 2023-12-07T17:46:36.949429+0000 mgr.smithi172.nqsqxd (mgr.14199) 1529 : cluster 0 pgmap v1299: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:40.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:40 smithi172 bash[24902]: cluster 2023-12-07T17:46:38.950098+0000 mgr.smithi172.nqsqxd (mgr.14199) 1530 : cluster 0 pgmap v1300: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:40.751 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:40.751 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:41.558 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:42.560 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:42.574 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:42 smithi172 bash[24902]: audit 2023-12-07T17:46:40.739718+0000 mgr.smithi172.nqsqxd (mgr.14199) 1531 : audit 0 from='client.14940 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:42.574 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:42 smithi172 bash[24902]: cluster 2023-12-07T17:46:40.950819+0000 mgr.smithi172.nqsqxd (mgr.14199) 1532 : cluster 0 pgmap v1301: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:44.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:44 smithi172 bash[24902]: cluster 2023-12-07T17:46:42.951767+0000 mgr.smithi172.nqsqxd (mgr.14199) 1533 : cluster 0 pgmap v1302: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:46.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:46 smithi172 bash[24902]: cluster 2023-12-07T17:46:44.952629+0000 mgr.smithi172.nqsqxd (mgr.14199) 1534 : cluster 0 pgmap v1303: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:47.354 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:48.601 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:48 smithi172 bash[24902]: cluster 2023-12-07T17:46:46.953568+0000 mgr.smithi172.nqsqxd (mgr.14199) 1535 : cluster 0 pgmap v1304: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:49.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:49 smithi172 bash[24902]: audit 2023-12-07T17:46:49.136575+0000 mon.smithi172 (mon.0) 823 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:46:50.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:50 smithi172 bash[24902]: cluster 2023-12-07T17:46:48.954254+0000 mgr.smithi172.nqsqxd (mgr.14199) 1536 : cluster 0 pgmap v1305: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:50.821 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:46:50.821 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:46:51.622 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:46:52.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:46:52.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:52 smithi172 bash[24902]: audit 2023-12-07T17:46:50.808731+0000 mgr.smithi172.nqsqxd (mgr.14199) 1537 : audit 0 from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:46:52.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:52 smithi172 bash[24902]: cluster 2023-12-07T17:46:50.954925+0000 mgr.smithi172.nqsqxd (mgr.14199) 1538 : cluster 0 pgmap v1306: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:54.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:54 smithi172 bash[24902]: cluster 2023-12-07T17:46:52.955791+0000 mgr.smithi172.nqsqxd (mgr.14199) 1539 : cluster 0 pgmap v1307: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:56.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:56 smithi172 bash[24902]: cluster 2023-12-07T17:46:54.956405+0000 mgr.smithi172.nqsqxd (mgr.14199) 1540 : cluster 0 pgmap v1308: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:46:57.421 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:46:58.483 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:46:58 smithi172 bash[24902]: cluster 2023-12-07T17:46:56.957160+0000 mgr.smithi172.nqsqxd (mgr.14199) 1541 : cluster 0 pgmap v1309: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:00.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:00 smithi172 bash[24902]: cluster 2023-12-07T17:46:58.957551+0000 mgr.smithi172.nqsqxd (mgr.14199) 1542 : cluster 0 pgmap v1310: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:00.778 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:00.778 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:01.575 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:02.576 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:02.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:02 smithi172 bash[24902]: audit 2023-12-07T17:47:00.765333+0000 mgr.smithi172.nqsqxd (mgr.14199) 1543 : audit 0 from='client.14944 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:02.588 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:02 smithi172 bash[24902]: cluster 2023-12-07T17:47:00.958132+0000 mgr.smithi172.nqsqxd (mgr.14199) 1544 : cluster 0 pgmap v1311: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:04 smithi172 bash[24902]: cluster 2023-12-07T17:47:02.958997+0000 mgr.smithi172.nqsqxd (mgr.14199) 1545 : cluster 0 pgmap v1312: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:04 smithi172 bash[24902]: audit 2023-12-07T17:47:04.136947+0000 mon.smithi172 (mon.0) 824 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:47:06.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:06 smithi172 bash[24902]: cluster 2023-12-07T17:47:04.959659+0000 mgr.smithi172.nqsqxd (mgr.14199) 1546 : cluster 0 pgmap v1313: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:07.363 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:08.541 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:08 smithi172 bash[24902]: cluster 2023-12-07T17:47:06.960517+0000 mgr.smithi172.nqsqxd (mgr.14199) 1547 : cluster 0 pgmap v1314: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:10.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:10 smithi172 bash[24902]: cluster 2023-12-07T17:47:08.961123+0000 mgr.smithi172.nqsqxd (mgr.14199) 1548 : cluster 0 pgmap v1315: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:10.567 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:10.567 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:11.396 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:11.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:11 smithi172 bash[24902]: audit 2023-12-07T17:47:10.553276+0000 mgr.smithi172.nqsqxd (mgr.14199) 1549 : audit 0 from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:11.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:11 smithi172 bash[24902]: audit 2023-12-07T17:47:10.996562+0000 mon.smithi172 (mon.0) 825 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:47:12.397 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: cluster 2023-12-07T17:47:10.961573+0000 mgr.smithi172.nqsqxd (mgr.14199) 1550 : cluster 0 pgmap v1316: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: audit 2023-12-07T17:47:11.621379+0000 mon.smithi172 (mon.0) 826 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: audit 2023-12-07T17:47:11.623356+0000 mon.smithi172 (mon.0) 827 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: cluster 2023-12-07T17:47:11.626386+0000 mgr.smithi172.nqsqxd (mgr.14199) 1551 : cluster 0 pgmap v1317: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: cluster 2023-12-07T17:47:11.626842+0000 mgr.smithi172.nqsqxd (mgr.14199) 1552 : cluster 0 pgmap v1318: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:12 smithi172 bash[24902]: audit 2023-12-07T17:47:11.631957+0000 mon.smithi172 (mon.0) 828 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:47:14.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:13 smithi172 bash[24902]: cluster 2023-12-07T17:47:13.627442+0000 mgr.smithi172.nqsqxd (mgr.14199) 1553 : cluster 0 pgmap v1319: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:16.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:15 smithi172 bash[24902]: cluster 2023-12-07T17:47:15.628175+0000 mgr.smithi172.nqsqxd (mgr.14199) 1554 : cluster 0 pgmap v1320: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:17.189 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:18.526 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:18 smithi172 bash[24902]: cluster 2023-12-07T17:47:17.628946+0000 mgr.smithi172.nqsqxd (mgr.14199) 1555 : cluster 0 pgmap v1321: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:19.551 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:19 smithi172 bash[24902]: audit 2023-12-07T17:47:19.136546+0000 mon.smithi172 (mon.0) 829 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:47:20.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:20 smithi172 bash[24902]: cluster 2023-12-07T17:47:19.629636+0000 mgr.smithi172.nqsqxd (mgr.14199) 1556 : cluster 0 pgmap v1322: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:20.828 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:20.828 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:21.680 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:22.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:21 smithi172 bash[24902]: audit 2023-12-07T17:47:20.814840+0000 mgr.smithi172.nqsqxd (mgr.14199) 1557 : audit 0 from='client.14948 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:22.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:21 smithi172 bash[24902]: cluster 2023-12-07T17:47:21.630513+0000 mgr.smithi172.nqsqxd (mgr.14199) 1558 : cluster 0 pgmap v1323: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:22.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:24.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:23 smithi172 bash[24902]: cluster 2023-12-07T17:47:23.631187+0000 mgr.smithi172.nqsqxd (mgr.14199) 1559 : cluster 0 pgmap v1324: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:26.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:25 smithi172 bash[24902]: cluster 2023-12-07T17:47:25.631848+0000 mgr.smithi172.nqsqxd (mgr.14199) 1560 : cluster 0 pgmap v1325: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:27.487 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:28.531 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:28 smithi172 bash[24902]: cluster 2023-12-07T17:47:27.632339+0000 mgr.smithi172.nqsqxd (mgr.14199) 1561 : cluster 0 pgmap v1326: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:29.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:29 smithi172 bash[24902]: cluster 2023-12-07T17:47:29.632965+0000 mgr.smithi172.nqsqxd (mgr.14199) 1562 : cluster 0 pgmap v1327: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:30.824 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:30.824 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:31.700 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:32.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:31 smithi172 bash[24902]: audit 2023-12-07T17:47:30.810249+0000 mgr.smithi172.nqsqxd (mgr.14199) 1563 : audit 0 from='client.14950 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:32.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:31 smithi172 bash[24902]: cluster 2023-12-07T17:47:31.633765+0000 mgr.smithi172.nqsqxd (mgr.14199) 1564 : cluster 0 pgmap v1328: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:32.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:34.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:33 smithi172 bash[24902]: cluster 2023-12-07T17:47:33.634436+0000 mgr.smithi172.nqsqxd (mgr.14199) 1565 : cluster 0 pgmap v1329: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:35.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:34 smithi172 bash[24902]: audit 2023-12-07T17:47:34.137640+0000 mon.smithi172 (mon.0) 830 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:47:36.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:35 smithi172 bash[24902]: cluster 2023-12-07T17:47:35.635065+0000 mgr.smithi172.nqsqxd (mgr.14199) 1566 : cluster 0 pgmap v1330: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:37.499 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:38.511 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:38 smithi172 bash[24902]: cluster 2023-12-07T17:47:37.635891+0000 mgr.smithi172.nqsqxd (mgr.14199) 1567 : cluster 0 pgmap v1331: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:39.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:39 smithi172 bash[24902]: cluster 2023-12-07T17:47:39.636548+0000 mgr.smithi172.nqsqxd (mgr.14199) 1568 : cluster 0 pgmap v1332: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:40.820 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:40.820 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:41.701 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:42.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:41 smithi172 bash[24902]: audit 2023-12-07T17:47:40.806891+0000 mgr.smithi172.nqsqxd (mgr.14199) 1569 : audit 0 from='client.14952 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:42.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:41 smithi172 bash[24902]: cluster 2023-12-07T17:47:41.637412+0000 mgr.smithi172.nqsqxd (mgr.14199) 1570 : cluster 0 pgmap v1333: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:42.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:44.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:43 smithi172 bash[24902]: cluster 2023-12-07T17:47:43.638083+0000 mgr.smithi172.nqsqxd (mgr.14199) 1571 : cluster 0 pgmap v1334: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:47.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:46 smithi172 bash[24902]: cluster 2023-12-07T17:47:45.639035+0000 mgr.smithi172.nqsqxd (mgr.14199) 1572 : cluster 0 pgmap v1335: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:47.502 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:49.559 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:49 smithi172 bash[24902]: cluster 2023-12-07T17:47:47.639858+0000 mgr.smithi172.nqsqxd (mgr.14199) 1573 : cluster 0 pgmap v1336: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:49.559 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:49 smithi172 bash[24902]: audit 2023-12-07T17:47:49.138088+0000 mon.smithi172 (mon.0) 831 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:47:50.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:47:50.979 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:47:51.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:51 smithi172 bash[24902]: cluster 2023-12-07T17:47:49.640559+0000 mgr.smithi172.nqsqxd (mgr.14199) 1574 : cluster 0 pgmap v1337: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:51.751 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:47:52.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:52 smithi172 bash[24902]: audit 2023-12-07T17:47:50.969663+0000 mgr.smithi172.nqsqxd (mgr.14199) 1575 : audit 0 from='client.14954 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:47:52.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:47:53.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:53 smithi172 bash[24902]: cluster 2023-12-07T17:47:51.641368+0000 mgr.smithi172.nqsqxd (mgr.14199) 1576 : cluster 0 pgmap v1338: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:55.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:55 smithi172 bash[24902]: cluster 2023-12-07T17:47:53.641929+0000 mgr.smithi172.nqsqxd (mgr.14199) 1577 : cluster 0 pgmap v1339: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:57.547 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:47:57.577 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:57 smithi172 bash[24902]: cluster 2023-12-07T17:47:55.642618+0000 mgr.smithi172.nqsqxd (mgr.14199) 1578 : cluster 0 pgmap v1340: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:47:59.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:47:59 smithi172 bash[24902]: cluster 2023-12-07T17:47:57.643436+0000 mgr.smithi172.nqsqxd (mgr.14199) 1579 : cluster 0 pgmap v1341: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:00.744 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:00.745 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:01.542 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:01 smithi172 bash[24902]: cluster 2023-12-07T17:47:59.644084+0000 mgr.smithi172.nqsqxd (mgr.14199) 1580 : cluster 0 pgmap v1342: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:01.543 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:02.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:02.557 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:02 smithi172 bash[24902]: audit 2023-12-07T17:48:00.730857+0000 mgr.smithi172.nqsqxd (mgr.14199) 1581 : audit 0 from='client.14956 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:03 smithi172 bash[24902]: cluster 2023-12-07T17:48:01.644926+0000 mgr.smithi172.nqsqxd (mgr.14199) 1582 : cluster 0 pgmap v1343: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:04.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:04 smithi172 bash[24902]: audit 2023-12-07T17:48:04.138550+0000 mon.smithi172 (mon.0) 832 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:48:05.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:05 smithi172 bash[24902]: cluster 2023-12-07T17:48:03.645569+0000 mgr.smithi172.nqsqxd (mgr.14199) 1583 : cluster 0 pgmap v1344: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:07.341 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:07.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:07 smithi172 bash[24902]: cluster 2023-12-07T17:48:05.646256+0000 mgr.smithi172.nqsqxd (mgr.14199) 1584 : cluster 0 pgmap v1345: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:09.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:09 smithi172 bash[24902]: cluster 2023-12-07T17:48:07.647099+0000 mgr.smithi172.nqsqxd (mgr.14199) 1585 : cluster 0 pgmap v1346: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:10.799 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:10.799 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:11.384 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:11 smithi172 bash[24902]: cluster 2023-12-07T17:48:09.647775+0000 mgr.smithi172.nqsqxd (mgr.14199) 1586 : cluster 0 pgmap v1347: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:11.615 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:12.616 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:12 smithi172 bash[24902]: audit 2023-12-07T17:48:10.786695+0000 mgr.smithi172.nqsqxd (mgr.14199) 1587 : audit 0 from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:12 smithi172 bash[24902]: audit 2023-12-07T17:48:11.682564+0000 mon.smithi172 (mon.0) 833 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:48:13.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: cluster 2023-12-07T17:48:11.648629+0000 mgr.smithi172.nqsqxd (mgr.14199) 1588 : cluster 0 pgmap v1348: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: audit 2023-12-07T17:48:12.310480+0000 mon.smithi172 (mon.0) 834 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:48:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: audit 2023-12-07T17:48:12.312130+0000 mon.smithi172 (mon.0) 835 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:48:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: cluster 2023-12-07T17:48:12.315070+0000 mgr.smithi172.nqsqxd (mgr.14199) 1589 : cluster 0 pgmap v1349: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: cluster 2023-12-07T17:48:12.315559+0000 mgr.smithi172.nqsqxd (mgr.14199) 1590 : cluster 0 pgmap v1350: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:13 smithi172 bash[24902]: audit 2023-12-07T17:48:12.322691+0000 mon.smithi172 (mon.0) 836 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:48:15.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:15 smithi172 bash[24902]: cluster 2023-12-07T17:48:14.316173+0000 mgr.smithi172.nqsqxd (mgr.14199) 1591 : cluster 0 pgmap v1351: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:17.409 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:17.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:17 smithi172 bash[24902]: cluster 2023-12-07T17:48:16.316978+0000 mgr.smithi172.nqsqxd (mgr.14199) 1592 : cluster 0 pgmap v1352: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:19 smithi172 bash[24902]: cluster 2023-12-07T17:48:18.317610+0000 mgr.smithi172.nqsqxd (mgr.14199) 1593 : cluster 0 pgmap v1353: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:19 smithi172 bash[24902]: audit 2023-12-07T17:48:19.139095+0000 mon.smithi172 (mon.0) 837 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:48:20.761 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:20.761 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:21.582 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:21.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:21 smithi172 bash[24902]: cluster 2023-12-07T17:48:20.318122+0000 mgr.smithi172.nqsqxd (mgr.14199) 1594 : cluster 0 pgmap v1354: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:22.583 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:22.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:22 smithi172 bash[24902]: audit 2023-12-07T17:48:20.747657+0000 mgr.smithi172.nqsqxd (mgr.14199) 1595 : audit 0 from='client.14960 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:23.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:23 smithi172 bash[24902]: cluster 2023-12-07T17:48:22.319071+0000 mgr.smithi172.nqsqxd (mgr.14199) 1596 : cluster 0 pgmap v1355: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:25.724 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:25 smithi172 bash[24902]: cluster 2023-12-07T17:48:24.319759+0000 mgr.smithi172.nqsqxd (mgr.14199) 1597 : cluster 0 pgmap v1356: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:27.381 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:27.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:27 smithi172 bash[24902]: cluster 2023-12-07T17:48:26.320591+0000 mgr.smithi172.nqsqxd (mgr.14199) 1598 : cluster 0 pgmap v1357: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:29.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:29 smithi172 bash[24902]: cluster 2023-12-07T17:48:28.321269+0000 mgr.smithi172.nqsqxd (mgr.14199) 1599 : cluster 0 pgmap v1358: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:30.792 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:30.792 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:31.661 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:31 smithi172 bash[24902]: cluster 2023-12-07T17:48:30.322069+0000 mgr.smithi172.nqsqxd (mgr.14199) 1600 : cluster 0 pgmap v1359: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:31.662 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:32.663 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:32.678 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:32 smithi172 bash[24902]: audit 2023-12-07T17:48:30.778722+0000 mgr.smithi172.nqsqxd (mgr.14199) 1601 : audit 0 from='client.14962 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:33.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:33 smithi172 bash[24902]: cluster 2023-12-07T17:48:32.322978+0000 mgr.smithi172.nqsqxd (mgr.14199) 1602 : cluster 0 pgmap v1360: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:34 smithi172 bash[24902]: audit 2023-12-07T17:48:34.139621+0000 mon.smithi172 (mon.0) 838 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:48:35.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:35 smithi172 bash[24902]: cluster 2023-12-07T17:48:34.323587+0000 mgr.smithi172.nqsqxd (mgr.14199) 1603 : cluster 0 pgmap v1361: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:37.461 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:37.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:37 smithi172 bash[24902]: cluster 2023-12-07T17:48:36.324506+0000 mgr.smithi172.nqsqxd (mgr.14199) 1604 : cluster 0 pgmap v1362: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:39.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:39 smithi172 bash[24902]: cluster 2023-12-07T17:48:38.325189+0000 mgr.smithi172.nqsqxd (mgr.14199) 1605 : cluster 0 pgmap v1363: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:40.863 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:40.863 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:41.730 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:41 smithi172 bash[24902]: cluster 2023-12-07T17:48:40.326235+0000 mgr.smithi172.nqsqxd (mgr.14199) 1606 : cluster 0 pgmap v1364: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:41.731 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:42.733 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:42.746 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:42 smithi172 bash[24902]: audit 2023-12-07T17:48:40.850201+0000 mgr.smithi172.nqsqxd (mgr.14199) 1607 : audit 0 from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:43.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:43 smithi172 bash[24902]: cluster 2023-12-07T17:48:42.327453+0000 mgr.smithi172.nqsqxd (mgr.14199) 1608 : cluster 0 pgmap v1365: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:45.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:45 smithi172 bash[24902]: cluster 2023-12-07T17:48:44.328136+0000 mgr.smithi172.nqsqxd (mgr.14199) 1609 : cluster 0 pgmap v1366: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:47.529 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:47.561 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:47 smithi172 bash[24902]: cluster 2023-12-07T17:48:46.328971+0000 mgr.smithi172.nqsqxd (mgr.14199) 1610 : cluster 0 pgmap v1367: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:49 smithi172 bash[24902]: cluster 2023-12-07T17:48:48.329688+0000 mgr.smithi172.nqsqxd (mgr.14199) 1611 : cluster 0 pgmap v1368: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:49 smithi172 bash[24902]: audit 2023-12-07T17:48:49.139763+0000 mon.smithi172 (mon.0) 839 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:48:50.688 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:48:50.688 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:48:51.485 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:51 smithi172 bash[24902]: cluster 2023-12-07T17:48:50.330303+0000 mgr.smithi172.nqsqxd (mgr.14199) 1612 : cluster 0 pgmap v1369: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:51.486 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:48:52.487 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:48:52.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:52 smithi172 bash[24902]: audit 2023-12-07T17:48:50.679192+0000 mgr.smithi172.nqsqxd (mgr.14199) 1613 : audit 0 from='client.14966 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:48:53.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:53 smithi172 bash[24902]: cluster 2023-12-07T17:48:52.331143+0000 mgr.smithi172.nqsqxd (mgr.14199) 1614 : cluster 0 pgmap v1370: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:55.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:55 smithi172 bash[24902]: cluster 2023-12-07T17:48:54.331853+0000 mgr.smithi172.nqsqxd (mgr.14199) 1615 : cluster 0 pgmap v1371: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:57.286 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:48:57.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:57 smithi172 bash[24902]: cluster 2023-12-07T17:48:56.332472+0000 mgr.smithi172.nqsqxd (mgr.14199) 1616 : cluster 0 pgmap v1372: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:48:59.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:48:59 smithi172 bash[24902]: cluster 2023-12-07T17:48:58.333204+0000 mgr.smithi172.nqsqxd (mgr.14199) 1617 : cluster 0 pgmap v1373: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:00.861 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:00.862 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:01 smithi172 bash[24902]: cluster 2023-12-07T17:49:00.333933+0000 mgr.smithi172.nqsqxd (mgr.14199) 1618 : cluster 0 pgmap v1374: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:01.674 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:02.675 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:02.686 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:02 smithi172 bash[24902]: audit 2023-12-07T17:49:00.847695+0000 mgr.smithi172.nqsqxd (mgr.14199) 1619 : audit 0 from='client.14968 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:03.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:03 smithi172 bash[24902]: cluster 2023-12-07T17:49:02.334770+0000 mgr.smithi172.nqsqxd (mgr.14199) 1620 : cluster 0 pgmap v1375: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:04 smithi172 bash[24902]: audit 2023-12-07T17:49:04.140484+0000 mon.smithi172 (mon.0) 840 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:49:05.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:05 smithi172 bash[24902]: cluster 2023-12-07T17:49:04.335196+0000 mgr.smithi172.nqsqxd (mgr.14199) 1621 : cluster 0 pgmap v1376: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:07.474 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:07.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:07 smithi172 bash[24902]: cluster 2023-12-07T17:49:06.335968+0000 mgr.smithi172.nqsqxd (mgr.14199) 1622 : cluster 0 pgmap v1377: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:09.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:09 smithi172 bash[24902]: cluster 2023-12-07T17:49:08.336578+0000 mgr.smithi172.nqsqxd (mgr.14199) 1623 : cluster 0 pgmap v1378: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:10.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:10.856 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:11.699 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:11.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:11 smithi172 bash[24902]: cluster 2023-12-07T17:49:10.337205+0000 mgr.smithi172.nqsqxd (mgr.14199) 1624 : cluster 0 pgmap v1379: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:12.701 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:12.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:12 smithi172 bash[24902]: audit 2023-12-07T17:49:10.841730+0000 mgr.smithi172.nqsqxd (mgr.14199) 1625 : audit 0 from='client.14970 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:12.712 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:12 smithi172 bash[24902]: audit 2023-12-07T17:49:12.374131+0000 mon.smithi172 (mon.0) 841 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:49:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:13 smithi172 bash[24902]: cluster 2023-12-07T17:49:12.337770+0000 mgr.smithi172.nqsqxd (mgr.14199) 1626 : cluster 0 pgmap v1380: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:13 smithi172 bash[24902]: audit 2023-12-07T17:49:12.954737+0000 mon.smithi172 (mon.0) 842 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:49:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:13 smithi172 bash[24902]: audit 2023-12-07T17:49:12.956207+0000 mon.smithi172 (mon.0) 843 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:49:13.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:13 smithi172 bash[24902]: audit 2023-12-07T17:49:12.964534+0000 mon.smithi172 (mon.0) 844 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:49:14.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:14 smithi172 bash[24902]: cluster 2023-12-07T17:49:12.958723+0000 mgr.smithi172.nqsqxd (mgr.14199) 1627 : cluster 0 pgmap v1381: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:14.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:14 smithi172 bash[24902]: cluster 2023-12-07T17:49:12.959289+0000 mgr.smithi172.nqsqxd (mgr.14199) 1628 : cluster 0 pgmap v1382: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:16.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:16 smithi172 bash[24902]: cluster 2023-12-07T17:49:14.959906+0000 mgr.smithi172.nqsqxd (mgr.14199) 1629 : cluster 0 pgmap v1383: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:17.485 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:18.733 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:18 smithi172 bash[24902]: cluster 2023-12-07T17:49:16.960551+0000 mgr.smithi172.nqsqxd (mgr.14199) 1630 : cluster 0 pgmap v1384: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:19.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:19 smithi172 bash[24902]: audit 2023-12-07T17:49:19.139856+0000 mon.smithi172 (mon.0) 845 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:49:20.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:20 smithi172 bash[24902]: cluster 2023-12-07T17:49:18.961207+0000 mgr.smithi172.nqsqxd (mgr.14199) 1631 : cluster 0 pgmap v1385: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:20.960 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:20.960 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:21.807 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:22.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:22.822 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:22 smithi172 bash[24902]: audit 2023-12-07T17:49:20.945977+0000 mgr.smithi172.nqsqxd (mgr.14199) 1632 : audit 0 from='client.14972 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:22.822 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:22 smithi172 bash[24902]: cluster 2023-12-07T17:49:20.961808+0000 mgr.smithi172.nqsqxd (mgr.14199) 1633 : cluster 0 pgmap v1386: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:24.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:24 smithi172 bash[24902]: cluster 2023-12-07T17:49:22.962594+0000 mgr.smithi172.nqsqxd (mgr.14199) 1634 : cluster 0 pgmap v1387: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:26.804 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:26 smithi172 bash[24902]: cluster 2023-12-07T17:49:24.963196+0000 mgr.smithi172.nqsqxd (mgr.14199) 1635 : cluster 0 pgmap v1388: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:27.605 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:28.749 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:28 smithi172 bash[24902]: cluster 2023-12-07T17:49:26.964027+0000 mgr.smithi172.nqsqxd (mgr.14199) 1636 : cluster 0 pgmap v1389: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:30.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:30 smithi172 bash[24902]: cluster 2023-12-07T17:49:28.964454+0000 mgr.smithi172.nqsqxd (mgr.14199) 1637 : cluster 0 pgmap v1390: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:30.927 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:30.927 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:31.811 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:32.812 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:32.826 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:32 smithi172 bash[24902]: audit 2023-12-07T17:49:30.918434+0000 mgr.smithi172.nqsqxd (mgr.14199) 1638 : audit 0 from='client.14974 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:32.826 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:32 smithi172 bash[24902]: cluster 2023-12-07T17:49:30.965021+0000 mgr.smithi172.nqsqxd (mgr.14199) 1639 : cluster 0 pgmap v1391: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:34 smithi172 bash[24902]: cluster 2023-12-07T17:49:32.965791+0000 mgr.smithi172.nqsqxd (mgr.14199) 1640 : cluster 0 pgmap v1392: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:34 smithi172 bash[24902]: audit 2023-12-07T17:49:34.140853+0000 mon.smithi172 (mon.0) 846 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:49:36.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:36 smithi172 bash[24902]: cluster 2023-12-07T17:49:34.966495+0000 mgr.smithi172.nqsqxd (mgr.14199) 1641 : cluster 0 pgmap v1393: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:37.618 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:38.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:38 smithi172 bash[24902]: cluster 2023-12-07T17:49:36.967255+0000 mgr.smithi172.nqsqxd (mgr.14199) 1642 : cluster 0 pgmap v1394: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:40.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:40 smithi172 bash[24902]: cluster 2023-12-07T17:49:38.967910+0000 mgr.smithi172.nqsqxd (mgr.14199) 1643 : cluster 0 pgmap v1395: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:40.913 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:40.913 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:41.700 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:42.702 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:42.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:42 smithi172 bash[24902]: audit 2023-12-07T17:49:40.900504+0000 mgr.smithi172.nqsqxd (mgr.14199) 1644 : audit 0 from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:42.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:42 smithi172 bash[24902]: cluster 2023-12-07T17:49:40.968503+0000 mgr.smithi172.nqsqxd (mgr.14199) 1645 : cluster 0 pgmap v1396: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:44.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:44 smithi172 bash[24902]: cluster 2023-12-07T17:49:42.969338+0000 mgr.smithi172.nqsqxd (mgr.14199) 1646 : cluster 0 pgmap v1397: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:46.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:46 smithi172 bash[24902]: cluster 2023-12-07T17:49:44.969959+0000 mgr.smithi172.nqsqxd (mgr.14199) 1647 : cluster 0 pgmap v1398: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:47.494 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:48.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:48 smithi172 bash[24902]: cluster 2023-12-07T17:49:46.970752+0000 mgr.smithi172.nqsqxd (mgr.14199) 1648 : cluster 0 pgmap v1399: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:49 smithi172 bash[24902]: audit 2023-12-07T17:49:49.141035+0000 mon.smithi172 (mon.0) 847 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:49:50.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:50 smithi172 bash[24902]: cluster 2023-12-07T17:49:48.971436+0000 mgr.smithi172.nqsqxd (mgr.14199) 1649 : cluster 0 pgmap v1400: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:50.915 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:49:50.916 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:49:51.749 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:49:52.750 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:49:52.763 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:52 smithi172 bash[24902]: audit 2023-12-07T17:49:50.903017+0000 mgr.smithi172.nqsqxd (mgr.14199) 1650 : audit 0 from='client.14978 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:49:52.763 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:52 smithi172 bash[24902]: cluster 2023-12-07T17:49:50.972109+0000 mgr.smithi172.nqsqxd (mgr.14199) 1651 : cluster 0 pgmap v1401: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:54.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:54 smithi172 bash[24902]: cluster 2023-12-07T17:49:52.972946+0000 mgr.smithi172.nqsqxd (mgr.14199) 1652 : cluster 0 pgmap v1402: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:56.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:56 smithi172 bash[24902]: cluster 2023-12-07T17:49:54.973704+0000 mgr.smithi172.nqsqxd (mgr.14199) 1653 : cluster 0 pgmap v1403: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:49:57.543 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:49:58.806 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:49:58 smithi172 bash[24902]: cluster 2023-12-07T17:49:56.974559+0000 mgr.smithi172.nqsqxd (mgr.14199) 1654 : cluster 0 pgmap v1404: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:00.874 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:00.874 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:00.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:00 smithi172 bash[24902]: cluster 2023-12-07T17:49:58.975182+0000 mgr.smithi172.nqsqxd (mgr.14199) 1655 : cluster 0 pgmap v1405: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:01.780 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:02.781 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:02.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:02 smithi172 bash[24902]: audit 2023-12-07T17:50:00.860707+0000 mgr.smithi172.nqsqxd (mgr.14199) 1656 : audit 0 from='client.14980 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:02.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:02 smithi172 bash[24902]: cluster 2023-12-07T17:50:00.975868+0000 mgr.smithi172.nqsqxd (mgr.14199) 1657 : cluster 0 pgmap v1406: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:04 smithi172 bash[24902]: cluster 2023-12-07T17:50:02.976624+0000 mgr.smithi172.nqsqxd (mgr.14199) 1658 : cluster 0 pgmap v1407: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:04 smithi172 bash[24902]: audit 2023-12-07T17:50:04.141617+0000 mon.smithi172 (mon.0) 848 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:50:06.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:06 smithi172 bash[24902]: cluster 2023-12-07T17:50:04.977399+0000 mgr.smithi172.nqsqxd (mgr.14199) 1659 : cluster 0 pgmap v1408: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:07.580 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:08.853 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:08 smithi172 bash[24902]: cluster 2023-12-07T17:50:06.978200+0000 mgr.smithi172.nqsqxd (mgr.14199) 1660 : cluster 0 pgmap v1409: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:10.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:10 smithi172 bash[24902]: cluster 2023-12-07T17:50:08.978880+0000 mgr.smithi172.nqsqxd (mgr.14199) 1661 : cluster 0 pgmap v1410: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:10.951 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:10.951 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:11.784 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:12.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:12.798 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:12 smithi172 bash[24902]: audit 2023-12-07T17:50:10.938669+0000 mgr.smithi172.nqsqxd (mgr.14199) 1662 : audit 0 from='client.14982 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:12.799 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:12 smithi172 bash[24902]: cluster 2023-12-07T17:50:10.979439+0000 mgr.smithi172.nqsqxd (mgr.14199) 1663 : cluster 0 pgmap v1411: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:13 smithi172 bash[24902]: audit 2023-12-07T17:50:13.014633+0000 mon.smithi172 (mon.0) 849 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: cluster 2023-12-07T17:50:12.980110+0000 mgr.smithi172.nqsqxd (mgr.14199) 1664 : cluster 0 pgmap v1412: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: audit 2023-12-07T17:50:13.639504+0000 mon.smithi172 (mon.0) 850 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: audit 2023-12-07T17:50:13.641457+0000 mon.smithi172 (mon.0) 851 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: cluster 2023-12-07T17:50:13.644214+0000 mgr.smithi172.nqsqxd (mgr.14199) 1665 : cluster 0 pgmap v1413: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: cluster 2023-12-07T17:50:13.644636+0000 mgr.smithi172.nqsqxd (mgr.14199) 1666 : cluster 0 pgmap v1414: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:14 smithi172 bash[24902]: audit 2023-12-07T17:50:13.652211+0000 mon.smithi172 (mon.0) 852 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:50:16.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:15 smithi172 bash[24902]: cluster 2023-12-07T17:50:15.645261+0000 mgr.smithi172.nqsqxd (mgr.14199) 1667 : cluster 0 pgmap v1415: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:17.576 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:18.627 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:18 smithi172 bash[24902]: cluster 2023-12-07T17:50:17.646121+0000 mgr.smithi172.nqsqxd (mgr.14199) 1668 : cluster 0 pgmap v1416: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:19.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:19 smithi172 bash[24902]: audit 2023-12-07T17:50:19.142090+0000 mon.smithi172 (mon.0) 853 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:50:20.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:20 smithi172 bash[24902]: cluster 2023-12-07T17:50:19.646845+0000 mgr.smithi172.nqsqxd (mgr.14199) 1669 : cluster 0 pgmap v1417: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:21.147 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:21.147 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:22.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:21 smithi172 bash[24902]: audit 2023-12-07T17:50:21.138319+0000 mgr.smithi172.nqsqxd (mgr.14199) 1670 : audit 0 from='client.14984 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:22.015 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:21 smithi172 bash[24902]: cluster 2023-12-07T17:50:21.647333+0000 mgr.smithi172.nqsqxd (mgr.14199) 1671 : cluster 0 pgmap v1418: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:22.016 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:23.017 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:24.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:23 smithi172 bash[24902]: cluster 2023-12-07T17:50:23.648054+0000 mgr.smithi172.nqsqxd (mgr.14199) 1672 : cluster 0 pgmap v1419: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:26.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:25 smithi172 bash[24902]: cluster 2023-12-07T17:50:25.648715+0000 mgr.smithi172.nqsqxd (mgr.14199) 1673 : cluster 0 pgmap v1420: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:27.819 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:28.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:28 smithi172 bash[24902]: cluster 2023-12-07T17:50:27.649505+0000 mgr.smithi172.nqsqxd (mgr.14199) 1674 : cluster 0 pgmap v1421: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:30.035 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:29 smithi172 bash[24902]: cluster 2023-12-07T17:50:29.650186+0000 mgr.smithi172.nqsqxd (mgr.14199) 1675 : cluster 0 pgmap v1422: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:31.440 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:31.440 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:31.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:31 smithi172 bash[24902]: audit 2023-12-07T17:50:31.425268+0000 mgr.smithi172.nqsqxd (mgr.14199) 1676 : audit 0 from='client.14986 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:31.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:31 smithi172 bash[24902]: cluster 2023-12-07T17:50:31.650776+0000 mgr.smithi172.nqsqxd (mgr.14199) 1677 : cluster 0 pgmap v1423: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:32.258 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:33.258 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:34.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:33 smithi172 bash[24902]: cluster 2023-12-07T17:50:33.651409+0000 mgr.smithi172.nqsqxd (mgr.14199) 1678 : cluster 0 pgmap v1424: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:35.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:34 smithi172 bash[24902]: audit 2023-12-07T17:50:34.142394+0000 mon.smithi172 (mon.0) 854 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:50:36.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:35 smithi172 bash[24902]: cluster 2023-12-07T17:50:35.652161+0000 mgr.smithi172.nqsqxd (mgr.14199) 1679 : cluster 0 pgmap v1425: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:38.057 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:38.382 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:38 smithi172 bash[24902]: cluster 2023-12-07T17:50:37.653133+0000 mgr.smithi172.nqsqxd (mgr.14199) 1680 : cluster 0 pgmap v1426: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:40.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:39 smithi172 bash[24902]: cluster 2023-12-07T17:50:39.653786+0000 mgr.smithi172.nqsqxd (mgr.14199) 1681 : cluster 0 pgmap v1427: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:41.560 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:41.560 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:41 smithi172 bash[24902]: audit 2023-12-07T17:50:41.546440+0000 mgr.smithi172.nqsqxd (mgr.14199) 1682 : audit 0 from='client.14988 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:41.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:41 smithi172 bash[24902]: cluster 2023-12-07T17:50:41.654558+0000 mgr.smithi172.nqsqxd (mgr.14199) 1683 : cluster 0 pgmap v1428: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:42.406 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:43.408 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:44.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:43 smithi172 bash[24902]: cluster 2023-12-07T17:50:43.655212+0000 mgr.smithi172.nqsqxd (mgr.14199) 1684 : cluster 0 pgmap v1429: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:46.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:45 smithi172 bash[24902]: cluster 2023-12-07T17:50:45.655811+0000 mgr.smithi172.nqsqxd (mgr.14199) 1685 : cluster 0 pgmap v1430: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:48.201 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:48.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:48 smithi172 bash[24902]: cluster 2023-12-07T17:50:47.656683+0000 mgr.smithi172.nqsqxd (mgr.14199) 1686 : cluster 0 pgmap v1431: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:49.561 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:49 smithi172 bash[24902]: audit 2023-12-07T17:50:49.142815+0000 mon.smithi172 (mon.0) 855 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:50:50.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:50 smithi172 bash[24902]: cluster 2023-12-07T17:50:49.657350+0000 mgr.smithi172.nqsqxd (mgr.14199) 1687 : cluster 0 pgmap v1432: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:51.643 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:50:51.644 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:50:52.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:51 smithi172 bash[24902]: audit 2023-12-07T17:50:51.631142+0000 mgr.smithi172.nqsqxd (mgr.14199) 1688 : audit 0 from='client.14990 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:50:52.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:51 smithi172 bash[24902]: cluster 2023-12-07T17:50:51.657861+0000 mgr.smithi172.nqsqxd (mgr.14199) 1689 : cluster 0 pgmap v1433: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:52.441 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:50:53.443 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:50:54.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:53 smithi172 bash[24902]: cluster 2023-12-07T17:50:53.658499+0000 mgr.smithi172.nqsqxd (mgr.14199) 1690 : cluster 0 pgmap v1434: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:56.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:55 smithi172 bash[24902]: cluster 2023-12-07T17:50:55.659106+0000 mgr.smithi172.nqsqxd (mgr.14199) 1691 : cluster 0 pgmap v1435: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:50:58.231 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:50:58.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:58 smithi172 bash[24902]: cluster 2023-12-07T17:50:57.659961+0000 mgr.smithi172.nqsqxd (mgr.14199) 1692 : cluster 0 pgmap v1436: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:00.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:50:59 smithi172 bash[24902]: cluster 2023-12-07T17:50:59.660624+0000 mgr.smithi172.nqsqxd (mgr.14199) 1693 : cluster 0 pgmap v1437: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:01.642 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:01.642 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:02.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:01 smithi172 bash[24902]: audit 2023-12-07T17:51:01.631333+0000 mgr.smithi172.nqsqxd (mgr.14199) 1694 : audit 0 from='client.14992 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:02.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:01 smithi172 bash[24902]: cluster 2023-12-07T17:51:01.661388+0000 mgr.smithi172.nqsqxd (mgr.14199) 1695 : cluster 0 pgmap v1438: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:02.463 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:03.464 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:04.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:03 smithi172 bash[24902]: cluster 2023-12-07T17:51:03.661889+0000 mgr.smithi172.nqsqxd (mgr.14199) 1696 : cluster 0 pgmap v1439: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:05.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:04 smithi172 bash[24902]: audit 2023-12-07T17:51:04.143545+0000 mon.smithi172 (mon.0) 856 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:51:06.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:05 smithi172 bash[24902]: cluster 2023-12-07T17:51:05.662548+0000 mgr.smithi172.nqsqxd (mgr.14199) 1697 : cluster 0 pgmap v1440: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:08.273 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:08.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:08 smithi172 bash[24902]: cluster 2023-12-07T17:51:07.663308+0000 mgr.smithi172.nqsqxd (mgr.14199) 1698 : cluster 0 pgmap v1441: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:10.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:09 smithi172 bash[24902]: cluster 2023-12-07T17:51:09.663980+0000 mgr.smithi172.nqsqxd (mgr.14199) 1699 : cluster 0 pgmap v1442: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:11.667 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:11.667 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:12.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:11 smithi172 bash[24902]: audit 2023-12-07T17:51:11.651269+0000 mgr.smithi172.nqsqxd (mgr.14199) 1700 : audit 0 from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:12.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:11 smithi172 bash[24902]: cluster 2023-12-07T17:51:11.664659+0000 mgr.smithi172.nqsqxd (mgr.14199) 1701 : cluster 0 pgmap v1443: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:12.544 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:13.545 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:13 smithi172 bash[24902]: cluster 2023-12-07T17:51:13.665298+0000 mgr.smithi172.nqsqxd (mgr.14199) 1702 : cluster 0 pgmap v1444: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:13.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:13 smithi172 bash[24902]: audit 2023-12-07T17:51:13.704837+0000 mon.smithi172 (mon.0) 857 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:51:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:14 smithi172 bash[24902]: audit 2023-12-07T17:51:14.331414+0000 mon.smithi172 (mon.0) 858 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:51:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:14 smithi172 bash[24902]: audit 2023-12-07T17:51:14.333269+0000 mon.smithi172 (mon.0) 859 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:51:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:14 smithi172 bash[24902]: cluster 2023-12-07T17:51:14.335966+0000 mgr.smithi172.nqsqxd (mgr.14199) 1703 : cluster 0 pgmap v1445: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:14 smithi172 bash[24902]: cluster 2023-12-07T17:51:14.336420+0000 mgr.smithi172.nqsqxd (mgr.14199) 1704 : cluster 0 pgmap v1446: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:14 smithi172 bash[24902]: audit 2023-12-07T17:51:14.341696+0000 mon.smithi172 (mon.0) 860 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:51:17.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:17 smithi172 bash[24902]: cluster 2023-12-07T17:51:16.337263+0000 mgr.smithi172.nqsqxd (mgr.14199) 1705 : cluster 0 pgmap v1447: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:18.334 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:19.677 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:19 smithi172 bash[24902]: cluster 2023-12-07T17:51:18.337944+0000 mgr.smithi172.nqsqxd (mgr.14199) 1706 : cluster 0 pgmap v1448: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:19.677 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:19 smithi172 bash[24902]: audit 2023-12-07T17:51:19.143819+0000 mon.smithi172 (mon.0) 861 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:51:21.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:21 smithi172 bash[24902]: cluster 2023-12-07T17:51:20.338608+0000 mgr.smithi172.nqsqxd (mgr.14199) 1707 : cluster 0 pgmap v1449: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:21.826 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:21.826 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:22.638 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:23.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:23 smithi172 bash[24902]: audit 2023-12-07T17:51:21.812222+0000 mgr.smithi172.nqsqxd (mgr.14199) 1708 : audit 0 from='client.14996 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:23.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:23 smithi172 bash[24902]: cluster 2023-12-07T17:51:22.339074+0000 mgr.smithi172.nqsqxd (mgr.14199) 1709 : cluster 0 pgmap v1450: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:23.639 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:25.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:25 smithi172 bash[24902]: cluster 2023-12-07T17:51:24.339654+0000 mgr.smithi172.nqsqxd (mgr.14199) 1710 : cluster 0 pgmap v1451: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:27.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:27 smithi172 bash[24902]: cluster 2023-12-07T17:51:26.340462+0000 mgr.smithi172.nqsqxd (mgr.14199) 1711 : cluster 0 pgmap v1452: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:28.430 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:29.717 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:29 smithi172 bash[24902]: cluster 2023-12-07T17:51:28.340916+0000 mgr.smithi172.nqsqxd (mgr.14199) 1712 : cluster 0 pgmap v1453: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:31.859 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:31.860 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:31.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:31 smithi172 bash[24902]: cluster 2023-12-07T17:51:30.341552+0000 mgr.smithi172.nqsqxd (mgr.14199) 1713 : cluster 0 pgmap v1454: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:32.680 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:33.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:33 smithi172 bash[24902]: audit 2023-12-07T17:51:31.844100+0000 mgr.smithi172.nqsqxd (mgr.14199) 1714 : audit 0 from='client.14998 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:33.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:33 smithi172 bash[24902]: cluster 2023-12-07T17:51:32.342114+0000 mgr.smithi172.nqsqxd (mgr.14199) 1715 : cluster 0 pgmap v1455: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:33.681 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:34.379 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:34 smithi172 bash[24902]: audit 2023-12-07T17:51:34.143880+0000 mon.smithi172 (mon.0) 862 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:51:35.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:35 smithi172 bash[24902]: cluster 2023-12-07T17:51:34.342739+0000 mgr.smithi172.nqsqxd (mgr.14199) 1716 : cluster 0 pgmap v1456: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:37.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:37 smithi172 bash[24902]: cluster 2023-12-07T17:51:36.343240+0000 mgr.smithi172.nqsqxd (mgr.14199) 1717 : cluster 0 pgmap v1457: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:38.480 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:39.463 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:39 smithi172 bash[24902]: cluster 2023-12-07T17:51:38.343886+0000 mgr.smithi172.nqsqxd (mgr.14199) 1718 : cluster 0 pgmap v1458: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:41.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:41 smithi172 bash[24902]: cluster 2023-12-07T17:51:40.344458+0000 mgr.smithi172.nqsqxd (mgr.14199) 1719 : cluster 0 pgmap v1459: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:41.662 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:41.663 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:42.439 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:42.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:42 smithi172 bash[24902]: audit 2023-12-07T17:51:41.649817+0000 mgr.smithi172.nqsqxd (mgr.14199) 1720 : audit 0 from='client.15000 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:43.440 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:43.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:43 smithi172 bash[24902]: cluster 2023-12-07T17:51:42.345218+0000 mgr.smithi172.nqsqxd (mgr.14199) 1721 : cluster 0 pgmap v1460: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:45.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:45 smithi172 bash[24902]: cluster 2023-12-07T17:51:44.345725+0000 mgr.smithi172.nqsqxd (mgr.14199) 1722 : cluster 0 pgmap v1461: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:47.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:47 smithi172 bash[24902]: cluster 2023-12-07T17:51:46.346552+0000 mgr.smithi172.nqsqxd (mgr.14199) 1723 : cluster 0 pgmap v1462: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:48.239 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:49.582 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:49 smithi172 bash[24902]: cluster 2023-12-07T17:51:48.347216+0000 mgr.smithi172.nqsqxd (mgr.14199) 1724 : cluster 0 pgmap v1463: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:49.582 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:49 smithi172 bash[24902]: audit 2023-12-07T17:51:49.144170+0000 mon.smithi172 (mon.0) 863 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:51:51.493 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:51:51.493 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:51:51.741 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:51 smithi172 bash[24902]: cluster 2023-12-07T17:51:50.347896+0000 mgr.smithi172.nqsqxd (mgr.14199) 1725 : cluster 0 pgmap v1464: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:52.298 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:51:52.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:52 smithi172 bash[24902]: audit 2023-12-07T17:51:51.478919+0000 mgr.smithi172.nqsqxd (mgr.14199) 1726 : audit 0 from='client.15002 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:51:53.299 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:51:53.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:53 smithi172 bash[24902]: cluster 2023-12-07T17:51:52.348451+0000 mgr.smithi172.nqsqxd (mgr.14199) 1727 : cluster 0 pgmap v1465: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:55.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:55 smithi172 bash[24902]: cluster 2023-12-07T17:51:54.349100+0000 mgr.smithi172.nqsqxd (mgr.14199) 1728 : cluster 0 pgmap v1466: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:57.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:57 smithi172 bash[24902]: cluster 2023-12-07T17:51:56.349893+0000 mgr.smithi172.nqsqxd (mgr.14199) 1729 : cluster 0 pgmap v1467: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:51:58.095 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:51:59.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:51:59 smithi172 bash[24902]: cluster 2023-12-07T17:51:58.350594+0000 mgr.smithi172.nqsqxd (mgr.14199) 1730 : cluster 0 pgmap v1468: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:01.459 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:01.459 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:01.696 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:01 smithi172 bash[24902]: cluster 2023-12-07T17:52:00.351136+0000 mgr.smithi172.nqsqxd (mgr.14199) 1731 : cluster 0 pgmap v1469: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:02.260 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:02.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:02 smithi172 bash[24902]: audit 2023-12-07T17:52:01.450013+0000 mgr.smithi172.nqsqxd (mgr.14199) 1732 : audit 0 from='client.15004 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:03.262 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:03.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:03 smithi172 bash[24902]: cluster 2023-12-07T17:52:02.351962+0000 mgr.smithi172.nqsqxd (mgr.14199) 1733 : cluster 0 pgmap v1470: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:04 smithi172 bash[24902]: audit 2023-12-07T17:52:04.144842+0000 mon.smithi172 (mon.0) 864 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:52:05.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:05 smithi172 bash[24902]: cluster 2023-12-07T17:52:04.352604+0000 mgr.smithi172.nqsqxd (mgr.14199) 1734 : cluster 0 pgmap v1471: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:07.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:07 smithi172 bash[24902]: cluster 2023-12-07T17:52:06.353602+0000 mgr.smithi172.nqsqxd (mgr.14199) 1735 : cluster 0 pgmap v1472: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:08.061 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:52:09.755 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:09 smithi172 bash[24902]: cluster 2023-12-07T17:52:08.354266+0000 mgr.smithi172.nqsqxd (mgr.14199) 1736 : cluster 0 pgmap v1473: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:11.546 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:11.546 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:11.761 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:11 smithi172 bash[24902]: cluster 2023-12-07T17:52:10.354809+0000 mgr.smithi172.nqsqxd (mgr.14199) 1737 : cluster 0 pgmap v1474: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:12.343 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:12.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:12 smithi172 bash[24902]: audit 2023-12-07T17:52:11.531703+0000 mgr.smithi172.nqsqxd (mgr.14199) 1738 : audit 0 from='client.15006 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:13.344 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:13.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:13 smithi172 bash[24902]: cluster 2023-12-07T17:52:12.355758+0000 mgr.smithi172.nqsqxd (mgr.14199) 1739 : cluster 0 pgmap v1475: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:14.847 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:14 smithi172 bash[24902]: audit 2023-12-07T17:52:14.391149+0000 mon.smithi172 (mon.0) 865 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:52:15.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:15 smithi172 bash[24902]: cluster 2023-12-07T17:52:14.356546+0000 mgr.smithi172.nqsqxd (mgr.14199) 1740 : cluster 0 pgmap v1476: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:15 smithi172 bash[24902]: audit 2023-12-07T17:52:15.014587+0000 mon.smithi172 (mon.0) 866 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:52:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:15 smithi172 bash[24902]: audit 2023-12-07T17:52:15.016543+0000 mon.smithi172 (mon.0) 867 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:52:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:15 smithi172 bash[24902]: audit 2023-12-07T17:52:15.026144+0000 mon.smithi172 (mon.0) 868 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:52:16.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:16 smithi172 bash[24902]: cluster 2023-12-07T17:52:15.019666+0000 mgr.smithi172.nqsqxd (mgr.14199) 1741 : cluster 0 pgmap v1477: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:16.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:16 smithi172 bash[24902]: cluster 2023-12-07T17:52:15.020128+0000 mgr.smithi172.nqsqxd (mgr.14199) 1742 : cluster 0 pgmap v1478: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:18.135 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:52:18.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:18 smithi172 bash[24902]: cluster 2023-12-07T17:52:17.020901+0000 mgr.smithi172.nqsqxd (mgr.14199) 1743 : cluster 0 pgmap v1479: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:19.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:19 smithi172 bash[24902]: audit 2023-12-07T17:52:19.145078+0000 mon.smithi172 (mon.0) 869 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:52:20.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:20 smithi172 bash[24902]: cluster 2023-12-07T17:52:19.021560+0000 mgr.smithi172.nqsqxd (mgr.14199) 1744 : cluster 0 pgmap v1480: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:21.802 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:21.802 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:22.641 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:22.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:22 smithi172 bash[24902]: cluster 2023-12-07T17:52:21.022210+0000 mgr.smithi172.nqsqxd (mgr.14199) 1745 : cluster 0 pgmap v1481: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:23.641 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:23.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:23 smithi172 bash[24902]: audit 2023-12-07T17:52:21.786544+0000 mgr.smithi172.nqsqxd (mgr.14199) 1746 : audit 0 from='client.15008 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:24.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:24 smithi172 bash[24902]: cluster 2023-12-07T17:52:23.022945+0000 mgr.smithi172.nqsqxd (mgr.14199) 1747 : cluster 0 pgmap v1482: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:26.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:26 smithi172 bash[24902]: cluster 2023-12-07T17:52:25.023617+0000 mgr.smithi172.nqsqxd (mgr.14199) 1748 : cluster 0 pgmap v1483: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:28.450 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:52:28.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:28 smithi172 bash[24902]: cluster 2023-12-07T17:52:27.024478+0000 mgr.smithi172.nqsqxd (mgr.14199) 1749 : cluster 0 pgmap v1484: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:30.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:30 smithi172 bash[24902]: cluster 2023-12-07T17:52:29.025175+0000 mgr.smithi172.nqsqxd (mgr.14199) 1750 : cluster 0 pgmap v1485: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:32.135 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:32.135 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:32.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:32 smithi172 bash[24902]: cluster 2023-12-07T17:52:31.025844+0000 mgr.smithi172.nqsqxd (mgr.14199) 1751 : cluster 0 pgmap v1486: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:32.959 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:33.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:33 smithi172 bash[24902]: audit 2023-12-07T17:52:32.123572+0000 mgr.smithi172.nqsqxd (mgr.14199) 1752 : audit 0 from='client.15010 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:33.960 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:34.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:34 smithi172 bash[24902]: cluster 2023-12-07T17:52:33.026647+0000 mgr.smithi172.nqsqxd (mgr.14199) 1753 : cluster 0 pgmap v1487: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:34 smithi172 bash[24902]: audit 2023-12-07T17:52:34.145368+0000 mon.smithi172 (mon.0) 870 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:52:36.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:36 smithi172 bash[24902]: cluster 2023-12-07T17:52:35.027201+0000 mgr.smithi172.nqsqxd (mgr.14199) 1754 : cluster 0 pgmap v1488: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:38.756 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:52:38.785 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:38 smithi172 bash[24902]: cluster 2023-12-07T17:52:37.027954+0000 mgr.smithi172.nqsqxd (mgr.14199) 1755 : cluster 0 pgmap v1489: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:40.852 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:40 smithi172 bash[24902]: cluster 2023-12-07T17:52:39.028628+0000 mgr.smithi172.nqsqxd (mgr.14199) 1756 : cluster 0 pgmap v1490: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:42.314 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:42.314 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:42.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:42 smithi172 bash[24902]: cluster 2023-12-07T17:52:41.029326+0000 mgr.smithi172.nqsqxd (mgr.14199) 1757 : cluster 0 pgmap v1491: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:43.156 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:43.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:43 smithi172 bash[24902]: audit 2023-12-07T17:52:42.301544+0000 mgr.smithi172.nqsqxd (mgr.14199) 1758 : audit 0 from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:44.157 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:44.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:44 smithi172 bash[24902]: cluster 2023-12-07T17:52:43.030107+0000 mgr.smithi172.nqsqxd (mgr.14199) 1759 : cluster 0 pgmap v1492: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:46.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:46 smithi172 bash[24902]: cluster 2023-12-07T17:52:45.030762+0000 mgr.smithi172.nqsqxd (mgr.14199) 1760 : cluster 0 pgmap v1493: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:48.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:48 smithi172 bash[24902]: cluster 2023-12-07T17:52:47.031553+0000 mgr.smithi172.nqsqxd (mgr.14199) 1761 : cluster 0 pgmap v1494: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:48.951 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:52:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:49 smithi172 bash[24902]: audit 2023-12-07T17:52:49.145825+0000 mon.smithi172 (mon.0) 871 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:52:50.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:50 smithi172 bash[24902]: cluster 2023-12-07T17:52:49.032240+0000 mgr.smithi172.nqsqxd (mgr.14199) 1762 : cluster 0 pgmap v1495: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:52.466 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:52:52.466 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:52:52.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:52 smithi172 bash[24902]: cluster 2023-12-07T17:52:51.033014+0000 mgr.smithi172.nqsqxd (mgr.14199) 1763 : cluster 0 pgmap v1496: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:53.341 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:52:53.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:53 smithi172 bash[24902]: audit 2023-12-07T17:52:52.452275+0000 mgr.smithi172.nqsqxd (mgr.14199) 1764 : audit 0 from='client.15014 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:52:54.343 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:52:54.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:54 smithi172 bash[24902]: cluster 2023-12-07T17:52:53.033821+0000 mgr.smithi172.nqsqxd (mgr.14199) 1765 : cluster 0 pgmap v1497: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:56.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:56 smithi172 bash[24902]: cluster 2023-12-07T17:52:55.034512+0000 mgr.smithi172.nqsqxd (mgr.14199) 1766 : cluster 0 pgmap v1498: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:58.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:52:58 smithi172 bash[24902]: cluster 2023-12-07T17:52:57.035315+0000 mgr.smithi172.nqsqxd (mgr.14199) 1767 : cluster 0 pgmap v1499: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:52:59.136 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:00.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:00 smithi172 bash[24902]: cluster 2023-12-07T17:52:59.035962+0000 mgr.smithi172.nqsqxd (mgr.14199) 1768 : cluster 0 pgmap v1500: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:02.685 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:02.685 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:02.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:02 smithi172 bash[24902]: cluster 2023-12-07T17:53:01.036683+0000 mgr.smithi172.nqsqxd (mgr.14199) 1769 : cluster 0 pgmap v1501: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:03.503 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:03.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:03 smithi172 bash[24902]: audit 2023-12-07T17:53:02.672363+0000 mgr.smithi172.nqsqxd (mgr.14199) 1770 : audit 0 from='client.15016 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:04.503 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:04.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:04 smithi172 bash[24902]: cluster 2023-12-07T17:53:03.037493+0000 mgr.smithi172.nqsqxd (mgr.14199) 1771 : cluster 0 pgmap v1502: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:04 smithi172 bash[24902]: audit 2023-12-07T17:53:04.146506+0000 mon.smithi172 (mon.0) 872 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:53:06.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:06 smithi172 bash[24902]: cluster 2023-12-07T17:53:05.038143+0000 mgr.smithi172.nqsqxd (mgr.14199) 1772 : cluster 0 pgmap v1503: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:08.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:08 smithi172 bash[24902]: cluster 2023-12-07T17:53:07.038982+0000 mgr.smithi172.nqsqxd (mgr.14199) 1773 : cluster 0 pgmap v1504: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:09.302 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:10.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:10 smithi172 bash[24902]: cluster 2023-12-07T17:53:09.039594+0000 mgr.smithi172.nqsqxd (mgr.14199) 1774 : cluster 0 pgmap v1505: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:12.637 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:12.638 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:12.867 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:12 smithi172 bash[24902]: cluster 2023-12-07T17:53:11.040408+0000 mgr.smithi172.nqsqxd (mgr.14199) 1775 : cluster 0 pgmap v1506: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:13.420 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:13 smithi172 bash[24902]: audit 2023-12-07T17:53:12.622585+0000 mgr.smithi172.nqsqxd (mgr.14199) 1776 : audit 0 from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:14.421 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:14.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:14 smithi172 bash[24902]: cluster 2023-12-07T17:53:13.041233+0000 mgr.smithi172.nqsqxd (mgr.14199) 1777 : cluster 0 pgmap v1507: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:15.864 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:15 smithi172 bash[24902]: audit 2023-12-07T17:53:15.077191+0000 mon.smithi172 (mon.0) 873 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:53:16.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:16 smithi172 bash[24902]: cluster 2023-12-07T17:53:15.041900+0000 mgr.smithi172.nqsqxd (mgr.14199) 1778 : cluster 0 pgmap v1508: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:16.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:16 smithi172 bash[24902]: audit 2023-12-07T17:53:15.704388+0000 mon.smithi172 (mon.0) 874 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:53:16.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:16 smithi172 bash[24902]: audit 2023-12-07T17:53:15.706038+0000 mon.smithi172 (mon.0) 875 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:53:16.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:16 smithi172 bash[24902]: audit 2023-12-07T17:53:15.713937+0000 mon.smithi172 (mon.0) 876 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:53:17.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:17 smithi172 bash[24902]: cluster 2023-12-07T17:53:15.708725+0000 mgr.smithi172.nqsqxd (mgr.14199) 1779 : cluster 0 pgmap v1509: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:17.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:17 smithi172 bash[24902]: cluster 2023-12-07T17:53:15.709097+0000 mgr.smithi172.nqsqxd (mgr.14199) 1780 : cluster 0 pgmap v1510: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:19.211 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:19 smithi172 bash[24902]: cluster 2023-12-07T17:53:17.709840+0000 mgr.smithi172.nqsqxd (mgr.14199) 1781 : cluster 0 pgmap v1511: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:19 smithi172 bash[24902]: audit 2023-12-07T17:53:19.146880+0000 mon.smithi172 (mon.0) 877 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:53:21.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:21 smithi172 bash[24902]: cluster 2023-12-07T17:53:19.710283+0000 mgr.smithi172.nqsqxd (mgr.14199) 1782 : cluster 0 pgmap v1512: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:22.825 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:22.825 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:23.621 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:23.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:23 smithi172 bash[24902]: cluster 2023-12-07T17:53:21.711024+0000 mgr.smithi172.nqsqxd (mgr.14199) 1783 : cluster 0 pgmap v1513: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:24.622 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:24.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:24 smithi172 bash[24902]: audit 2023-12-07T17:53:22.811163+0000 mgr.smithi172.nqsqxd (mgr.14199) 1784 : audit 0 from='client.15020 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:25.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:25 smithi172 bash[24902]: cluster 2023-12-07T17:53:23.711787+0000 mgr.smithi172.nqsqxd (mgr.14199) 1785 : cluster 0 pgmap v1514: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:27.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:27 smithi172 bash[24902]: cluster 2023-12-07T17:53:25.712482+0000 mgr.smithi172.nqsqxd (mgr.14199) 1786 : cluster 0 pgmap v1515: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:29.420 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:29.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:29 smithi172 bash[24902]: cluster 2023-12-07T17:53:27.713312+0000 mgr.smithi172.nqsqxd (mgr.14199) 1787 : cluster 0 pgmap v1516: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:31.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:31 smithi172 bash[24902]: cluster 2023-12-07T17:53:29.713980+0000 mgr.smithi172.nqsqxd (mgr.14199) 1788 : cluster 0 pgmap v1517: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:33.024 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:33.024 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:33.840 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:33.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:33 smithi172 bash[24902]: cluster 2023-12-07T17:53:31.714862+0000 mgr.smithi172.nqsqxd (mgr.14199) 1789 : cluster 0 pgmap v1518: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:34.842 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:35.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:34 smithi172 bash[24902]: audit 2023-12-07T17:53:33.010578+0000 mgr.smithi172.nqsqxd (mgr.14199) 1790 : audit 0 from='client.15022 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:35.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:34 smithi172 bash[24902]: audit 2023-12-07T17:53:34.147296+0000 mon.smithi172 (mon.0) 878 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:53:36.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:35 smithi172 bash[24902]: cluster 2023-12-07T17:53:33.715519+0000 mgr.smithi172.nqsqxd (mgr.14199) 1791 : cluster 0 pgmap v1519: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:38.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:37 smithi172 bash[24902]: cluster 2023-12-07T17:53:35.716187+0000 mgr.smithi172.nqsqxd (mgr.14199) 1792 : cluster 0 pgmap v1520: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:39.634 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:40.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:39 smithi172 bash[24902]: cluster 2023-12-07T17:53:37.717061+0000 mgr.smithi172.nqsqxd (mgr.14199) 1793 : cluster 0 pgmap v1521: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:42.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:41 smithi172 bash[24902]: cluster 2023-12-07T17:53:39.717709+0000 mgr.smithi172.nqsqxd (mgr.14199) 1794 : cluster 0 pgmap v1522: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:43.194 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:43.194 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:43.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:43 smithi172 bash[24902]: cluster 2023-12-07T17:53:41.718612+0000 mgr.smithi172.nqsqxd (mgr.14199) 1795 : cluster 0 pgmap v1523: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:44.031 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:45.032 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:45.047 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:44 smithi172 bash[24902]: audit 2023-12-07T17:53:43.180284+0000 mgr.smithi172.nqsqxd (mgr.14199) 1796 : audit 0 from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:46.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:45 smithi172 bash[24902]: cluster 2023-12-07T17:53:43.719002+0000 mgr.smithi172.nqsqxd (mgr.14199) 1797 : cluster 0 pgmap v1524: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:48.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:47 smithi172 bash[24902]: cluster 2023-12-07T17:53:45.719614+0000 mgr.smithi172.nqsqxd (mgr.14199) 1798 : cluster 0 pgmap v1525: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:49.831 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:53:50.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:49 smithi172 bash[24902]: cluster 2023-12-07T17:53:47.720451+0000 mgr.smithi172.nqsqxd (mgr.14199) 1799 : cluster 0 pgmap v1526: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:50.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:49 smithi172 bash[24902]: audit 2023-12-07T17:53:49.147524+0000 mon.smithi172 (mon.0) 879 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:53:51.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:51 smithi172 bash[24902]: cluster 2023-12-07T17:53:49.721093+0000 mgr.smithi172.nqsqxd (mgr.14199) 1800 : cluster 0 pgmap v1527: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:53.119 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:53:53.119 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:53:53.893 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:53:54.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:53 smithi172 bash[24902]: cluster 2023-12-07T17:53:51.721649+0000 mgr.smithi172.nqsqxd (mgr.14199) 1801 : cluster 0 pgmap v1528: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:54.894 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:53:55.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:54 smithi172 bash[24902]: audit 2023-12-07T17:53:53.103319+0000 mgr.smithi172.nqsqxd (mgr.14199) 1802 : audit 0 from='client.15026 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:53:56.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:55 smithi172 bash[24902]: cluster 2023-12-07T17:53:53.722285+0000 mgr.smithi172.nqsqxd (mgr.14199) 1803 : cluster 0 pgmap v1529: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:58.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:57 smithi172 bash[24902]: cluster 2023-12-07T17:53:55.723075+0000 mgr.smithi172.nqsqxd (mgr.14199) 1804 : cluster 0 pgmap v1530: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:53:59.690 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:00.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:53:59 smithi172 bash[24902]: cluster 2023-12-07T17:53:57.723937+0000 mgr.smithi172.nqsqxd (mgr.14199) 1805 : cluster 0 pgmap v1531: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:02.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:01 smithi172 bash[24902]: cluster 2023-12-07T17:53:59.724453+0000 mgr.smithi172.nqsqxd (mgr.14199) 1806 : cluster 0 pgmap v1532: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:03.142 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:03.142 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:03.888 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:04.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:03 smithi172 bash[24902]: cluster 2023-12-07T17:54:01.725366+0000 mgr.smithi172.nqsqxd (mgr.14199) 1807 : cluster 0 pgmap v1533: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:04.890 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:05.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:04 smithi172 bash[24902]: audit 2023-12-07T17:54:03.129430+0000 mgr.smithi172.nqsqxd (mgr.14199) 1808 : audit 0 from='client.15028 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:04 smithi172 bash[24902]: audit 2023-12-07T17:54:04.148015+0000 mon.smithi172 (mon.0) 880 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:54:06.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:05 smithi172 bash[24902]: cluster 2023-12-07T17:54:03.726037+0000 mgr.smithi172.nqsqxd (mgr.14199) 1809 : cluster 0 pgmap v1534: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:08.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:07 smithi172 bash[24902]: cluster 2023-12-07T17:54:05.726793+0000 mgr.smithi172.nqsqxd (mgr.14199) 1810 : cluster 0 pgmap v1535: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:09.686 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:10.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:09 smithi172 bash[24902]: cluster 2023-12-07T17:54:07.727701+0000 mgr.smithi172.nqsqxd (mgr.14199) 1811 : cluster 0 pgmap v1536: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:12.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:11 smithi172 bash[24902]: cluster 2023-12-07T17:54:09.728360+0000 mgr.smithi172.nqsqxd (mgr.14199) 1812 : cluster 0 pgmap v1537: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:13.273 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:13.273 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:13.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:13 smithi172 bash[24902]: cluster 2023-12-07T17:54:11.729133+0000 mgr.smithi172.nqsqxd (mgr.14199) 1813 : cluster 0 pgmap v1538: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:14.125 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:15.127 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:14 smithi172 bash[24902]: audit 2023-12-07T17:54:13.259190+0000 mgr.smithi172.nqsqxd (mgr.14199) 1814 : audit 0 from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:16.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:15 smithi172 bash[24902]: cluster 2023-12-07T17:54:13.729769+0000 mgr.smithi172.nqsqxd (mgr.14199) 1815 : cluster 0 pgmap v1539: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:16.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:16 smithi172 bash[24902]: audit 2023-12-07T17:54:15.764096+0000 mon.smithi172 (mon.0) 881 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:54:16.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:16 smithi172 bash[24902]: audit 2023-12-07T17:54:16.337522+0000 mon.smithi172 (mon.0) 882 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:54:16.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:16 smithi172 bash[24902]: audit 2023-12-07T17:54:16.338847+0000 mon.smithi172 (mon.0) 883 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:54:16.992 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:16 smithi172 bash[24902]: audit 2023-12-07T17:54:16.347853+0000 mon.smithi172 (mon.0) 884 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:54:18.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:17 smithi172 bash[24902]: cluster 2023-12-07T17:54:15.730386+0000 mgr.smithi172.nqsqxd (mgr.14199) 1816 : cluster 0 pgmap v1540: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:18.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:17 smithi172 bash[24902]: cluster 2023-12-07T17:54:16.342284+0000 mgr.smithi172.nqsqxd (mgr.14199) 1817 : cluster 0 pgmap v1541: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:19.921 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:20.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:19 smithi172 bash[24902]: cluster 2023-12-07T17:54:18.342882+0000 mgr.smithi172.nqsqxd (mgr.14199) 1818 : cluster 0 pgmap v1542: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:20.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:19 smithi172 bash[24902]: audit 2023-12-07T17:54:19.148286+0000 mon.smithi172 (mon.0) 885 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:54:21.976 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:21 smithi172 bash[24902]: cluster 2023-12-07T17:54:20.343474+0000 mgr.smithi172.nqsqxd (mgr.14199) 1819 : cluster 0 pgmap v1543: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:23.451 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:23.452 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:23.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:23 smithi172 bash[24902]: cluster 2023-12-07T17:54:22.344095+0000 mgr.smithi172.nqsqxd (mgr.14199) 1820 : cluster 0 pgmap v1544: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:24.338 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:24 smithi172 bash[24902]: audit 2023-12-07T17:54:23.436524+0000 mgr.smithi172.nqsqxd (mgr.14199) 1821 : audit 0 from='client.15032 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:25.339 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:26.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:25 smithi172 bash[24902]: cluster 2023-12-07T17:54:24.344807+0000 mgr.smithi172.nqsqxd (mgr.14199) 1822 : cluster 0 pgmap v1545: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:27.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:26 smithi172 bash[24902]: cluster 2023-12-07T17:54:26.345587+0000 mgr.smithi172.nqsqxd (mgr.14199) 1823 : cluster 0 pgmap v1546: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:29.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:29 smithi172 bash[24902]: cluster 2023-12-07T17:54:28.346274+0000 mgr.smithi172.nqsqxd (mgr.14199) 1824 : cluster 0 pgmap v1547: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:30.134 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:31.555 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:31 smithi172 bash[24902]: cluster 2023-12-07T17:54:30.346879+0000 mgr.smithi172.nqsqxd (mgr.14199) 1825 : cluster 0 pgmap v1548: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:33.364 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:33.364 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:33.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:33 smithi172 bash[24902]: cluster 2023-12-07T17:54:32.347573+0000 mgr.smithi172.nqsqxd (mgr.14199) 1826 : cluster 0 pgmap v1549: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:34.165 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:34.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:34 smithi172 bash[24902]: audit 2023-12-07T17:54:33.348099+0000 mgr.smithi172.nqsqxd (mgr.14199) 1827 : audit 0 from='client.15034 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:34.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:34 smithi172 bash[24902]: audit 2023-12-07T17:54:34.149021+0000 mon.smithi172 (mon.0) 886 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:54:35.166 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:35.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:35 smithi172 bash[24902]: cluster 2023-12-07T17:54:34.348192+0000 mgr.smithi172.nqsqxd (mgr.14199) 1828 : cluster 0 pgmap v1550: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:37.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:37 smithi172 bash[24902]: cluster 2023-12-07T17:54:36.348991+0000 mgr.smithi172.nqsqxd (mgr.14199) 1829 : cluster 0 pgmap v1551: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:39.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:39 smithi172 bash[24902]: cluster 2023-12-07T17:54:38.349664+0000 mgr.smithi172.nqsqxd (mgr.14199) 1830 : cluster 0 pgmap v1552: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:39.957 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:41.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:41 smithi172 bash[24902]: cluster 2023-12-07T17:54:40.350083+0000 mgr.smithi172.nqsqxd (mgr.14199) 1831 : cluster 0 pgmap v1553: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:43.351 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:43.351 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:43.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:43 smithi172 bash[24902]: cluster 2023-12-07T17:54:42.350976+0000 mgr.smithi172.nqsqxd (mgr.14199) 1832 : cluster 0 pgmap v1554: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:44.221 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:44.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:44 smithi172 bash[24902]: audit 2023-12-07T17:54:43.342166+0000 mgr.smithi172.nqsqxd (mgr.14199) 1833 : audit 0 from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:45.222 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:45.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:45 smithi172 bash[24902]: cluster 2023-12-07T17:54:44.351742+0000 mgr.smithi172.nqsqxd (mgr.14199) 1834 : cluster 0 pgmap v1555: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:47.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:47 smithi172 bash[24902]: cluster 2023-12-07T17:54:46.352540+0000 mgr.smithi172.nqsqxd (mgr.14199) 1835 : cluster 0 pgmap v1556: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:49 smithi172 bash[24902]: cluster 2023-12-07T17:54:48.353004+0000 mgr.smithi172.nqsqxd (mgr.14199) 1836 : cluster 0 pgmap v1557: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:49 smithi172 bash[24902]: audit 2023-12-07T17:54:49.149099+0000 mon.smithi172 (mon.0) 887 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:54:50.018 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:51.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:51 smithi172 bash[24902]: cluster 2023-12-07T17:54:50.353623+0000 mgr.smithi172.nqsqxd (mgr.14199) 1837 : cluster 0 pgmap v1558: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:53.085 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:54:53.086 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:54:53.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:53 smithi172 bash[24902]: cluster 2023-12-07T17:54:52.354307+0000 mgr.smithi172.nqsqxd (mgr.14199) 1838 : cluster 0 pgmap v1559: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:53.917 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:54:54.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:54 smithi172 bash[24902]: audit 2023-12-07T17:54:53.071672+0000 mgr.smithi172.nqsqxd (mgr.14199) 1839 : audit 0 from='client.15038 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:54:54.918 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:54:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:55 smithi172 bash[24902]: cluster 2023-12-07T17:54:54.354951+0000 mgr.smithi172.nqsqxd (mgr.14199) 1840 : cluster 0 pgmap v1560: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:57.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:57 smithi172 bash[24902]: cluster 2023-12-07T17:54:56.355509+0000 mgr.smithi172.nqsqxd (mgr.14199) 1841 : cluster 0 pgmap v1561: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:54:59.715 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:54:59.744 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:54:59 smithi172 bash[24902]: cluster 2023-12-07T17:54:58.356117+0000 mgr.smithi172.nqsqxd (mgr.14199) 1842 : cluster 0 pgmap v1562: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:01.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:01 smithi172 bash[24902]: cluster 2023-12-07T17:55:00.356887+0000 mgr.smithi172.nqsqxd (mgr.14199) 1843 : cluster 0 pgmap v1563: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:03.252 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:03.253 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:03.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:03 smithi172 bash[24902]: cluster 2023-12-07T17:55:02.357667+0000 mgr.smithi172.nqsqxd (mgr.14199) 1844 : cluster 0 pgmap v1564: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:04.100 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:04 smithi172 bash[24902]: audit 2023-12-07T17:55:03.239899+0000 mgr.smithi172.nqsqxd (mgr.14199) 1845 : audit 0 from='client.15040 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:04.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:04 smithi172 bash[24902]: audit 2023-12-07T17:55:04.149703+0000 mon.smithi172 (mon.0) 888 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:55:05.102 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:05.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:05 smithi172 bash[24902]: cluster 2023-12-07T17:55:04.358282+0000 mgr.smithi172.nqsqxd (mgr.14199) 1846 : cluster 0 pgmap v1565: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:07.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:07 smithi172 bash[24902]: cluster 2023-12-07T17:55:06.359182+0000 mgr.smithi172.nqsqxd (mgr.14199) 1847 : cluster 0 pgmap v1566: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:09.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:09 smithi172 bash[24902]: cluster 2023-12-07T17:55:08.360026+0000 mgr.smithi172.nqsqxd (mgr.14199) 1848 : cluster 0 pgmap v1567: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:09.909 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:55:11.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:11 smithi172 bash[24902]: cluster 2023-12-07T17:55:10.360853+0000 mgr.smithi172.nqsqxd (mgr.14199) 1849 : cluster 0 pgmap v1568: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:13.237 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:13.237 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:13.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:13 smithi172 bash[24902]: cluster 2023-12-07T17:55:12.361654+0000 mgr.smithi172.nqsqxd (mgr.14199) 1850 : cluster 0 pgmap v1569: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:14.059 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:14.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:14 smithi172 bash[24902]: audit 2023-12-07T17:55:13.227212+0000 mgr.smithi172.nqsqxd (mgr.14199) 1851 : audit 0 from='client.15042 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:15.060 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:15 smithi172 bash[24902]: cluster 2023-12-07T17:55:14.362399+0000 mgr.smithi172.nqsqxd (mgr.14199) 1852 : cluster 0 pgmap v1570: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:17.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:17 smithi172 bash[24902]: cluster 2023-12-07T17:55:16.363207+0000 mgr.smithi172.nqsqxd (mgr.14199) 1853 : cluster 0 pgmap v1571: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:17.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:17 smithi172 bash[24902]: audit 2023-12-07T17:55:16.397690+0000 mon.smithi172 (mon.0) 889 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:55:17.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:17 smithi172 bash[24902]: audit 2023-12-07T17:55:16.924641+0000 mon.smithi172 (mon.0) 890 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:55:17.631 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:17 smithi172 bash[24902]: audit 2023-12-07T17:55:16.933174+0000 mon.smithi172 (mon.0) 891 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:55:18.882 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:18 smithi172 bash[24902]: audit 2023-12-07T17:55:17.562048+0000 mon.smithi172 (mon.0) 892 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:55:18.882 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:18 smithi172 bash[24902]: audit 2023-12-07T17:55:17.563788+0000 mon.smithi172 (mon.0) 893 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:55:18.882 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:18 smithi172 bash[24902]: cluster 2023-12-07T17:55:17.566201+0000 mgr.smithi172.nqsqxd (mgr.14199) 1854 : cluster 0 pgmap v1572: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:18.882 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:18 smithi172 bash[24902]: cluster 2023-12-07T17:55:17.566697+0000 mgr.smithi172.nqsqxd (mgr.14199) 1855 : cluster 0 pgmap v1573: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:18.882 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:18 smithi172 bash[24902]: audit 2023-12-07T17:55:17.574022+0000 mon.smithi172 (mon.0) 894 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:55:19.848 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:55:19.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:19 smithi172 bash[24902]: audit 2023-12-07T17:55:19.149813+0000 mon.smithi172 (mon.0) 895 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:55:20.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:20 smithi172 bash[24902]: cluster 2023-12-07T17:55:19.567385+0000 mgr.smithi172.nqsqxd (mgr.14199) 1856 : cluster 0 pgmap v1574: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:22.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:22 smithi172 bash[24902]: cluster 2023-12-07T17:55:21.568258+0000 mgr.smithi172.nqsqxd (mgr.14199) 1857 : cluster 0 pgmap v1575: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:23.214 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:23.214 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:24.061 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:24.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:24 smithi172 bash[24902]: audit 2023-12-07T17:55:23.200004+0000 mgr.smithi172.nqsqxd (mgr.14199) 1858 : audit 0 from='client.15044 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:24.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:24 smithi172 bash[24902]: cluster 2023-12-07T17:55:23.568952+0000 mgr.smithi172.nqsqxd (mgr.14199) 1859 : cluster 0 pgmap v1576: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:25.062 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:27.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:26 smithi172 bash[24902]: cluster 2023-12-07T17:55:25.569677+0000 mgr.smithi172.nqsqxd (mgr.14199) 1860 : cluster 0 pgmap v1577: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:28.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:28 smithi172 bash[24902]: cluster 2023-12-07T17:55:27.570702+0000 mgr.smithi172.nqsqxd (mgr.14199) 1861 : cluster 0 pgmap v1578: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:29.860 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:55:30.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:30 smithi172 bash[24902]: cluster 2023-12-07T17:55:29.571343+0000 mgr.smithi172.nqsqxd (mgr.14199) 1862 : cluster 0 pgmap v1579: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:33.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:32 smithi172 bash[24902]: cluster 2023-12-07T17:55:31.572164+0000 mgr.smithi172.nqsqxd (mgr.14199) 1863 : cluster 0 pgmap v1580: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:33.146 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:33.146 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:33.956 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:34.957 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:34.969 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:34 smithi172 bash[24902]: audit 2023-12-07T17:55:33.136981+0000 mgr.smithi172.nqsqxd (mgr.14199) 1864 : audit 0 from='client.15046 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:34.970 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:34 smithi172 bash[24902]: cluster 2023-12-07T17:55:33.572666+0000 mgr.smithi172.nqsqxd (mgr.14199) 1865 : cluster 0 pgmap v1581: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:34.970 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:34 smithi172 bash[24902]: audit 2023-12-07T17:55:34.150325+0000 mon.smithi172 (mon.0) 896 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:55:37.129 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:36 smithi172 bash[24902]: cluster 2023-12-07T17:55:35.573321+0000 mgr.smithi172.nqsqxd (mgr.14199) 1866 : cluster 0 pgmap v1582: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:38.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:38 smithi172 bash[24902]: cluster 2023-12-07T17:55:37.574170+0000 mgr.smithi172.nqsqxd (mgr.14199) 1867 : cluster 0 pgmap v1583: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:39.750 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:55:40.955 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:40 smithi172 bash[24902]: cluster 2023-12-07T17:55:39.574918+0000 mgr.smithi172.nqsqxd (mgr.14199) 1868 : cluster 0 pgmap v1584: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:42.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:42 smithi172 bash[24902]: cluster 2023-12-07T17:55:41.575735+0000 mgr.smithi172.nqsqxd (mgr.14199) 1869 : cluster 0 pgmap v1585: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:43.006 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:43.007 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:43.765 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:44.766 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:45.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:44 smithi172 bash[24902]: audit 2023-12-07T17:55:42.993922+0000 mgr.smithi172.nqsqxd (mgr.14199) 1870 : audit 0 from='client.15048 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:45.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:44 smithi172 bash[24902]: cluster 2023-12-07T17:55:43.576197+0000 mgr.smithi172.nqsqxd (mgr.14199) 1871 : cluster 0 pgmap v1586: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:47.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:46 smithi172 bash[24902]: cluster 2023-12-07T17:55:45.576827+0000 mgr.smithi172.nqsqxd (mgr.14199) 1872 : cluster 0 pgmap v1587: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:48.633 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:48 smithi172 bash[24902]: cluster 2023-12-07T17:55:47.577678+0000 mgr.smithi172.nqsqxd (mgr.14199) 1873 : cluster 0 pgmap v1588: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:49.563 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:55:49.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:49 smithi172 bash[24902]: audit 2023-12-07T17:55:49.150565+0000 mon.smithi172 (mon.0) 897 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:55:50.670 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:50 smithi172 bash[24902]: cluster 2023-12-07T17:55:49.578181+0000 mgr.smithi172.nqsqxd (mgr.14199) 1874 : cluster 0 pgmap v1589: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:52.856 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:55:52.856 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:55:52.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:52 smithi172 bash[24902]: cluster 2023-12-07T17:55:51.578711+0000 mgr.smithi172.nqsqxd (mgr.14199) 1875 : cluster 0 pgmap v1590: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:53.683 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:55:54.684 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:55:55.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:54 smithi172 bash[24902]: audit 2023-12-07T17:55:52.841116+0000 mgr.smithi172.nqsqxd (mgr.14199) 1876 : audit 0 from='client.15050 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:55:55.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:54 smithi172 bash[24902]: cluster 2023-12-07T17:55:53.579281+0000 mgr.smithi172.nqsqxd (mgr.14199) 1877 : cluster 0 pgmap v1591: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:57.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:56 smithi172 bash[24902]: cluster 2023-12-07T17:55:55.579930+0000 mgr.smithi172.nqsqxd (mgr.14199) 1878 : cluster 0 pgmap v1592: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:58.832 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:55:58 smithi172 bash[24902]: cluster 2023-12-07T17:55:57.580760+0000 mgr.smithi172.nqsqxd (mgr.14199) 1879 : cluster 0 pgmap v1593: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:55:59.469 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:00.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:00 smithi172 bash[24902]: cluster 2023-12-07T17:55:59.581456+0000 mgr.smithi172.nqsqxd (mgr.14199) 1880 : cluster 0 pgmap v1594: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:02.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:02 smithi172 bash[24902]: cluster 2023-12-07T17:56:01.582392+0000 mgr.smithi172.nqsqxd (mgr.14199) 1881 : cluster 0 pgmap v1595: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:02.900 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:02.900 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:03.750 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:04.752 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:04 smithi172 bash[24902]: audit 2023-12-07T17:56:02.885402+0000 mgr.smithi172.nqsqxd (mgr.14199) 1882 : audit 0 from='client.15052 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:04 smithi172 bash[24902]: cluster 2023-12-07T17:56:03.583054+0000 mgr.smithi172.nqsqxd (mgr.14199) 1883 : cluster 0 pgmap v1596: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:04 smithi172 bash[24902]: audit 2023-12-07T17:56:04.151169+0000 mon.smithi172 (mon.0) 898 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:56:07.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:06 smithi172 bash[24902]: cluster 2023-12-07T17:56:05.583705+0000 mgr.smithi172.nqsqxd (mgr.14199) 1884 : cluster 0 pgmap v1597: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:08.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:08 smithi172 bash[24902]: cluster 2023-12-07T17:56:07.584521+0000 mgr.smithi172.nqsqxd (mgr.14199) 1885 : cluster 0 pgmap v1598: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:09.545 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:10.849 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:10 smithi172 bash[24902]: cluster 2023-12-07T17:56:09.585136+0000 mgr.smithi172.nqsqxd (mgr.14199) 1886 : cluster 0 pgmap v1599: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:12.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:12 smithi172 bash[24902]: cluster 2023-12-07T17:56:11.586011+0000 mgr.smithi172.nqsqxd (mgr.14199) 1887 : cluster 0 pgmap v1600: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:12.958 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:12.958 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:13.807 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:14.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:14 smithi172 bash[24902]: audit 2023-12-07T17:56:12.945050+0000 mgr.smithi172.nqsqxd (mgr.14199) 1888 : audit 0 from='client.15054 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:14 smithi172 bash[24902]: cluster 2023-12-07T17:56:13.586575+0000 mgr.smithi172.nqsqxd (mgr.14199) 1889 : cluster 0 pgmap v1601: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:17.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:16 smithi172 bash[24902]: cluster 2023-12-07T17:56:15.587182+0000 mgr.smithi172.nqsqxd (mgr.14199) 1890 : cluster 0 pgmap v1602: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:18.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:18 smithi172 bash[24902]: cluster 2023-12-07T17:56:17.588003+0000 mgr.smithi172.nqsqxd (mgr.14199) 1891 : cluster 0 pgmap v1603: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:18.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:18 smithi172 bash[24902]: audit 2023-12-07T17:56:17.625950+0000 mon.smithi172 (mon.0) 899 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:56:19.601 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:19.628 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:19 smithi172 bash[24902]: audit 2023-12-07T17:56:19.151564+0000 mon.smithi172 (mon.0) 900 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:56:20.646 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:20 smithi172 bash[24902]: cluster 2023-12-07T17:56:19.588845+0000 mgr.smithi172.nqsqxd (mgr.14199) 1892 : cluster 0 pgmap v1604: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:22.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:22 smithi172 bash[24902]: cluster 2023-12-07T17:56:21.589710+0000 mgr.smithi172.nqsqxd (mgr.14199) 1893 : cluster 0 pgmap v1605: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:22.966 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:22.966 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:46:10.296316Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:46:10.295586Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:46:10.295831Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:46:10.296559Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:46:10.295335Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:46:10.295050Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:46:10.296074Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:46:10.297285Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:46:10.297044Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:46:10.298173Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:23.762 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:24.763 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:22.956936+0000 mgr.smithi172.nqsqxd (mgr.14199) 1894 : audit 0 from='client.15056 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: cluster 2023-12-07T17:56:23.590226+0000 mgr.smithi172.nqsqxd (mgr.14199) 1895 : cluster 0 pgmap v1606: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:23.774026+0000 mon.smithi172 (mon.0) 901 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:23.785140+0000 mon.smithi172 (mon.0) 902 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:24.407834+0000 mon.smithi172 (mon.0) 903 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:24.408887+0000 mon.smithi172 (mon.0) 904 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:56:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:24 smithi172 bash[24902]: audit 2023-12-07T17:56:24.415499+0000 mon.smithi172 (mon.0) 905 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:56:26.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:25 smithi172 bash[24902]: cluster 2023-12-07T17:56:24.410368+0000 mgr.smithi172.nqsqxd (mgr.14199) 1896 : cluster 0 pgmap v1607: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:26.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:25 smithi172 bash[24902]: cluster 2023-12-07T17:56:24.410699+0000 mgr.smithi172.nqsqxd (mgr.14199) 1897 : cluster 0 pgmap v1608: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:28.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:27 smithi172 bash[24902]: cluster 2023-12-07T17:56:26.411391+0000 mgr.smithi172.nqsqxd (mgr.14199) 1898 : cluster 0 pgmap v1609: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:29.550 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:30.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:29 smithi172 bash[24902]: cluster 2023-12-07T17:56:28.412100+0000 mgr.smithi172.nqsqxd (mgr.14199) 1899 : cluster 0 pgmap v1610: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:32.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:31 smithi172 bash[24902]: cluster 2023-12-07T17:56:30.412640+0000 mgr.smithi172.nqsqxd (mgr.14199) 1900 : cluster 0 pgmap v1611: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:32.971 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:32.972 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:33.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:33 smithi172 bash[24902]: cluster 2023-12-07T17:56:32.413478+0000 mgr.smithi172.nqsqxd (mgr.14199) 1901 : cluster 0 pgmap v1612: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:33.781 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:34.782 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:34.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:34 smithi172 bash[24902]: audit 2023-12-07T17:56:32.961815+0000 mgr.smithi172.nqsqxd (mgr.14199) 1902 : audit 0 from='client.15058 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:34.795 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:34 smithi172 bash[24902]: audit 2023-12-07T17:56:34.151862+0000 mon.smithi172 (mon.0) 906 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:56:35.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:35 smithi172 bash[24902]: cluster 2023-12-07T17:56:34.414163+0000 mgr.smithi172.nqsqxd (mgr.14199) 1903 : cluster 0 pgmap v1613: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:37.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:37 smithi172 bash[24902]: cluster 2023-12-07T17:56:36.414855+0000 mgr.smithi172.nqsqxd (mgr.14199) 1904 : cluster 0 pgmap v1614: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:39.581 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:39.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:39 smithi172 bash[24902]: cluster 2023-12-07T17:56:38.415423+0000 mgr.smithi172.nqsqxd (mgr.14199) 1905 : cluster 0 pgmap v1615: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:41.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:41 smithi172 bash[24902]: cluster 2023-12-07T17:56:40.416086+0000 mgr.smithi172.nqsqxd (mgr.14199) 1906 : cluster 0 pgmap v1616: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:42.780 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:42.780 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:43.586 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:43.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:43 smithi172 bash[24902]: cluster 2023-12-07T17:56:42.416629+0000 mgr.smithi172.nqsqxd (mgr.14199) 1907 : cluster 0 pgmap v1617: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:44.587 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:44.669 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:44 smithi172 bash[24902]: audit 2023-12-07T17:56:42.766829+0000 mgr.smithi172.nqsqxd (mgr.14199) 1908 : audit 0 from='client.15060 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:45.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:45 smithi172 bash[24902]: cluster 2023-12-07T17:56:44.417255+0000 mgr.smithi172.nqsqxd (mgr.14199) 1909 : cluster 0 pgmap v1618: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:47.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:47 smithi172 bash[24902]: cluster 2023-12-07T17:56:46.418053+0000 mgr.smithi172.nqsqxd (mgr.14199) 1910 : cluster 0 pgmap v1619: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:49.402 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:49.768 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:49 smithi172 bash[24902]: cluster 2023-12-07T17:56:48.418718+0000 mgr.smithi172.nqsqxd (mgr.14199) 1911 : cluster 0 pgmap v1620: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:49.768 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:49 smithi172 bash[24902]: audit 2023-12-07T17:56:49.152250+0000 mon.smithi172 (mon.0) 907 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:56:51.756 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:51 smithi172 bash[24902]: cluster 2023-12-07T17:56:50.419335+0000 mgr.smithi172.nqsqxd (mgr.14199) 1912 : cluster 0 pgmap v1621: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:53.039 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:56:53.039 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:56:53.634 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:53 smithi172 bash[24902]: cluster 2023-12-07T17:56:52.420171+0000 mgr.smithi172.nqsqxd (mgr.14199) 1913 : cluster 0 pgmap v1622: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:53.853 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:56:54.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:56:54.867 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:54 smithi172 bash[24902]: audit 2023-12-07T17:56:53.026048+0000 mgr.smithi172.nqsqxd (mgr.14199) 1914 : audit 0 from='client.15062 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:56:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:55 smithi172 bash[24902]: cluster 2023-12-07T17:56:54.420654+0000 mgr.smithi172.nqsqxd (mgr.14199) 1915 : cluster 0 pgmap v1623: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:57.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:57 smithi172 bash[24902]: cluster 2023-12-07T17:56:56.421539+0000 mgr.smithi172.nqsqxd (mgr.14199) 1916 : cluster 0 pgmap v1624: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:56:59.659 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:56:59.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:56:59 smithi172 bash[24902]: cluster 2023-12-07T17:56:58.422280+0000 mgr.smithi172.nqsqxd (mgr.14199) 1917 : cluster 0 pgmap v1625: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:01.805 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:01 smithi172 bash[24902]: cluster 2023-12-07T17:57:00.422823+0000 mgr.smithi172.nqsqxd (mgr.14199) 1918 : cluster 0 pgmap v1626: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:03.208 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:03.208 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:03.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:03 smithi172 bash[24902]: cluster 2023-12-07T17:57:02.423550+0000 mgr.smithi172.nqsqxd (mgr.14199) 1919 : cluster 0 pgmap v1627: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:03.986 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:04 smithi172 bash[24902]: audit 2023-12-07T17:57:03.194638+0000 mgr.smithi172.nqsqxd (mgr.14199) 1920 : audit 0 from='client.15064 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:04 smithi172 bash[24902]: audit 2023-12-07T17:57:04.152756+0000 mon.smithi172 (mon.0) 908 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:57:04.987 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:05.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:05 smithi172 bash[24902]: cluster 2023-12-07T17:57:04.424286+0000 mgr.smithi172.nqsqxd (mgr.14199) 1921 : cluster 0 pgmap v1628: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:07.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:07 smithi172 bash[24902]: cluster 2023-12-07T17:57:06.424964+0000 mgr.smithi172.nqsqxd (mgr.14199) 1922 : cluster 0 pgmap v1629: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:09.791 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:57:09.817 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:09 smithi172 bash[24902]: cluster 2023-12-07T17:57:08.425745+0000 mgr.smithi172.nqsqxd (mgr.14199) 1923 : cluster 0 pgmap v1630: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:11.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:11 smithi172 bash[24902]: cluster 2023-12-07T17:57:10.426440+0000 mgr.smithi172.nqsqxd (mgr.14199) 1924 : cluster 0 pgmap v1631: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:13.420 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:13.420 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:13.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:13 smithi172 bash[24902]: cluster 2023-12-07T17:57:12.427200+0000 mgr.smithi172.nqsqxd (mgr.14199) 1925 : cluster 0 pgmap v1632: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:14.283 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:14.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:14 smithi172 bash[24902]: audit 2023-12-07T17:57:13.406674+0000 mgr.smithi172.nqsqxd (mgr.14199) 1926 : audit 0 from='client.15066 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:15.284 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:15.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:15 smithi172 bash[24902]: cluster 2023-12-07T17:57:14.427863+0000 mgr.smithi172.nqsqxd (mgr.14199) 1927 : cluster 0 pgmap v1633: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:17.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:17 smithi172 bash[24902]: cluster 2023-12-07T17:57:16.428620+0000 mgr.smithi172.nqsqxd (mgr.14199) 1928 : cluster 0 pgmap v1634: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:19 smithi172 bash[24902]: cluster 2023-12-07T17:57:18.429272+0000 mgr.smithi172.nqsqxd (mgr.14199) 1929 : cluster 0 pgmap v1635: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:19 smithi172 bash[24902]: audit 2023-12-07T17:57:19.152947+0000 mon.smithi172 (mon.0) 909 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:57:20.083 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:57:21.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:21 smithi172 bash[24902]: cluster 2023-12-07T17:57:20.429916+0000 mgr.smithi172.nqsqxd (mgr.14199) 1930 : cluster 0 pgmap v1636: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:23.609 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:23.609 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:23.629 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:23 smithi172 bash[24902]: cluster 2023-12-07T17:57:22.430519+0000 mgr.smithi172.nqsqxd (mgr.14199) 1931 : cluster 0 pgmap v1637: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:24.439 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:24.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:24 smithi172 bash[24902]: audit 2023-12-07T17:57:23.599313+0000 mgr.smithi172.nqsqxd (mgr.14199) 1932 : audit 0 from='client.15068 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:25.439 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:25 smithi172 bash[24902]: cluster 2023-12-07T17:57:24.431166+0000 mgr.smithi172.nqsqxd (mgr.14199) 1933 : cluster 0 pgmap v1638: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:25 smithi172 bash[24902]: audit 2023-12-07T17:57:24.467533+0000 mon.smithi172 (mon.0) 910 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:57:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:25 smithi172 bash[24902]: audit 2023-12-07T17:57:25.088053+0000 mon.smithi172 (mon.0) 911 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:57:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:25 smithi172 bash[24902]: audit 2023-12-07T17:57:25.089988+0000 mon.smithi172 (mon.0) 912 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:57:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:25 smithi172 bash[24902]: audit 2023-12-07T17:57:25.099111+0000 mon.smithi172 (mon.0) 913 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:57:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:26 smithi172 bash[24902]: cluster 2023-12-07T17:57:25.092805+0000 mgr.smithi172.nqsqxd (mgr.14199) 1934 : cluster 0 pgmap v1639: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:26 smithi172 bash[24902]: cluster 2023-12-07T17:57:25.093243+0000 mgr.smithi172.nqsqxd (mgr.14199) 1935 : cluster 0 pgmap v1640: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:28 smithi172 bash[24902]: cluster 2023-12-07T17:57:27.094060+0000 mgr.smithi172.nqsqxd (mgr.14199) 1936 : cluster 0 pgmap v1641: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:30.233 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:57:30.518 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:30 smithi172 bash[24902]: cluster 2023-12-07T17:57:29.094798+0000 mgr.smithi172.nqsqxd (mgr.14199) 1937 : cluster 0 pgmap v1642: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:32.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:32 smithi172 bash[24902]: cluster 2023-12-07T17:57:31.095546+0000 mgr.smithi172.nqsqxd (mgr.14199) 1938 : cluster 0 pgmap v1643: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:33.680 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:33.680 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:34.504 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:34 smithi172 bash[24902]: cluster 2023-12-07T17:57:33.096335+0000 mgr.smithi172.nqsqxd (mgr.14199) 1939 : cluster 0 pgmap v1644: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:34 smithi172 bash[24902]: audit 2023-12-07T17:57:33.667007+0000 mgr.smithi172.nqsqxd (mgr.14199) 1940 : audit 0 from='client.15070 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:34 smithi172 bash[24902]: audit 2023-12-07T17:57:34.152849+0000 mon.smithi172 (mon.0) 914 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:57:35.505 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:36.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:36 smithi172 bash[24902]: cluster 2023-12-07T17:57:35.097098+0000 mgr.smithi172.nqsqxd (mgr.14199) 1941 : cluster 0 pgmap v1645: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:38.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:38 smithi172 bash[24902]: cluster 2023-12-07T17:57:37.097926+0000 mgr.smithi172.nqsqxd (mgr.14199) 1942 : cluster 0 pgmap v1646: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:40.300 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:57:40.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:40 smithi172 bash[24902]: cluster 2023-12-07T17:57:39.098646+0000 mgr.smithi172.nqsqxd (mgr.14199) 1943 : cluster 0 pgmap v1647: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:42.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:42 smithi172 bash[24902]: cluster 2023-12-07T17:57:41.099307+0000 mgr.smithi172.nqsqxd (mgr.14199) 1944 : cluster 0 pgmap v1648: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:43.875 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:43.876 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:44.669 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:44.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:44 smithi172 bash[24902]: cluster 2023-12-07T17:57:43.100067+0000 mgr.smithi172.nqsqxd (mgr.14199) 1945 : cluster 0 pgmap v1649: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:45.671 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:45.793 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:45 smithi172 bash[24902]: audit 2023-12-07T17:57:43.861011+0000 mgr.smithi172.nqsqxd (mgr.14199) 1946 : audit 0 from='client.15072 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:46.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:46 smithi172 bash[24902]: cluster 2023-12-07T17:57:45.100703+0000 mgr.smithi172.nqsqxd (mgr.14199) 1947 : cluster 0 pgmap v1650: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:48.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:48 smithi172 bash[24902]: cluster 2023-12-07T17:57:47.101538+0000 mgr.smithi172.nqsqxd (mgr.14199) 1948 : cluster 0 pgmap v1651: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:49 smithi172 bash[24902]: audit 2023-12-07T17:57:49.153856+0000 mon.smithi172 (mon.0) 915 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:57:50.469 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:57:50.879 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:50 smithi172 bash[24902]: cluster 2023-12-07T17:57:49.102196+0000 mgr.smithi172.nqsqxd (mgr.14199) 1949 : cluster 0 pgmap v1652: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:52.727 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:52 smithi172 bash[24902]: cluster 2023-12-07T17:57:51.102969+0000 mgr.smithi172.nqsqxd (mgr.14199) 1950 : cluster 0 pgmap v1653: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:54.103 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:57:54.103 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:57:54.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:54 smithi172 bash[24902]: cluster 2023-12-07T17:57:53.103682+0000 mgr.smithi172.nqsqxd (mgr.14199) 1951 : cluster 0 pgmap v1654: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:54.894 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:57:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:55 smithi172 bash[24902]: audit 2023-12-07T17:57:54.087089+0000 mgr.smithi172.nqsqxd (mgr.14199) 1952 : audit 0 from='client.15074 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:57:55.895 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:57:56.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:56 smithi172 bash[24902]: cluster 2023-12-07T17:57:55.104340+0000 mgr.smithi172.nqsqxd (mgr.14199) 1953 : cluster 0 pgmap v1655: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:57:58.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:57:58 smithi172 bash[24902]: cluster 2023-12-07T17:57:57.105335+0000 mgr.smithi172.nqsqxd (mgr.14199) 1954 : cluster 0 pgmap v1656: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:00.694 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:00.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:00 smithi172 bash[24902]: cluster 2023-12-07T17:57:59.106056+0000 mgr.smithi172.nqsqxd (mgr.14199) 1955 : cluster 0 pgmap v1657: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:02.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:02 smithi172 bash[24902]: cluster 2023-12-07T17:58:01.106545+0000 mgr.smithi172.nqsqxd (mgr.14199) 1956 : cluster 0 pgmap v1658: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:04.059 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:04.060 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:04.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:04 smithi172 bash[24902]: cluster 2023-12-07T17:58:03.107260+0000 mgr.smithi172.nqsqxd (mgr.14199) 1957 : cluster 0 pgmap v1659: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:04.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:04 smithi172 bash[24902]: audit 2023-12-07T17:58:04.154212+0000 mon.smithi172 (mon.0) 916 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:58:04.893 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:05.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:05 smithi172 bash[24902]: audit 2023-12-07T17:58:04.047640+0000 mgr.smithi172.nqsqxd (mgr.14199) 1958 : audit 0 from='client.15076 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:05.895 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:06.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:06 smithi172 bash[24902]: cluster 2023-12-07T17:58:05.107932+0000 mgr.smithi172.nqsqxd (mgr.14199) 1959 : cluster 0 pgmap v1660: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:08.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:08 smithi172 bash[24902]: cluster 2023-12-07T17:58:07.108611+0000 mgr.smithi172.nqsqxd (mgr.14199) 1960 : cluster 0 pgmap v1661: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:10.684 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:10.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:10 smithi172 bash[24902]: cluster 2023-12-07T17:58:09.109393+0000 mgr.smithi172.nqsqxd (mgr.14199) 1961 : cluster 0 pgmap v1662: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:12.802 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:12 smithi172 bash[24902]: cluster 2023-12-07T17:58:11.110162+0000 mgr.smithi172.nqsqxd (mgr.14199) 1962 : cluster 0 pgmap v1663: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:14.138 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:14.138 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:14.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:14 smithi172 bash[24902]: cluster 2023-12-07T17:58:13.111096+0000 mgr.smithi172.nqsqxd (mgr.14199) 1963 : cluster 0 pgmap v1664: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:14.931 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:15 smithi172 bash[24902]: audit 2023-12-07T17:58:14.124167+0000 mgr.smithi172.nqsqxd (mgr.14199) 1964 : audit 0 from='client.15078 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:15.932 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:16.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:16 smithi172 bash[24902]: cluster 2023-12-07T17:58:15.111781+0000 mgr.smithi172.nqsqxd (mgr.14199) 1965 : cluster 0 pgmap v1665: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:18.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:18 smithi172 bash[24902]: cluster 2023-12-07T17:58:17.112548+0000 mgr.smithi172.nqsqxd (mgr.14199) 1966 : cluster 0 pgmap v1666: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:19 smithi172 bash[24902]: audit 2023-12-07T17:58:19.154621+0000 mon.smithi172 (mon.0) 917 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:58:20.736 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:20.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:20 smithi172 bash[24902]: cluster 2023-12-07T17:58:19.113258+0000 mgr.smithi172.nqsqxd (mgr.14199) 1967 : cluster 0 pgmap v1667: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:22.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:22 smithi172 bash[24902]: cluster 2023-12-07T17:58:21.113983+0000 mgr.smithi172.nqsqxd (mgr.14199) 1968 : cluster 0 pgmap v1668: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:24.079 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:24.080 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:24.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:24 smithi172 bash[24902]: cluster 2023-12-07T17:58:23.114612+0000 mgr.smithi172.nqsqxd (mgr.14199) 1969 : cluster 0 pgmap v1669: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:24.823 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:25.824 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:25.837 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:25 smithi172 bash[24902]: audit 2023-12-07T17:58:24.066670+0000 mgr.smithi172.nqsqxd (mgr.14199) 1970 : audit 0 from='client.15080 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:25.837 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:25 smithi172 bash[24902]: audit 2023-12-07T17:58:25.149116+0000 mon.smithi172 (mon.0) 918 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:58:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:26 smithi172 bash[24902]: cluster 2023-12-07T17:58:25.115227+0000 mgr.smithi172.nqsqxd (mgr.14199) 1971 : cluster 0 pgmap v1670: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:26 smithi172 bash[24902]: audit 2023-12-07T17:58:25.776145+0000 mon.smithi172 (mon.0) 919 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:58:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:26 smithi172 bash[24902]: audit 2023-12-07T17:58:25.777812+0000 mon.smithi172 (mon.0) 920 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:58:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:26 smithi172 bash[24902]: audit 2023-12-07T17:58:25.786700+0000 mon.smithi172 (mon.0) 921 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:58:27.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:27 smithi172 bash[24902]: cluster 2023-12-07T17:58:25.780502+0000 mgr.smithi172.nqsqxd (mgr.14199) 1972 : cluster 0 pgmap v1671: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:27.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:27 smithi172 bash[24902]: cluster 2023-12-07T17:58:25.780968+0000 mgr.smithi172.nqsqxd (mgr.14199) 1973 : cluster 0 pgmap v1672: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:29.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:29 smithi172 bash[24902]: cluster 2023-12-07T17:58:27.781702+0000 mgr.smithi172.nqsqxd (mgr.14199) 1974 : cluster 0 pgmap v1673: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:30.613 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:31.841 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:31 smithi172 bash[24902]: cluster 2023-12-07T17:58:29.782338+0000 mgr.smithi172.nqsqxd (mgr.14199) 1975 : cluster 0 pgmap v1674: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:33.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:33 smithi172 bash[24902]: cluster 2023-12-07T17:58:31.783145+0000 mgr.smithi172.nqsqxd (mgr.14199) 1976 : cluster 0 pgmap v1675: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:33.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:33.979 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:34.827 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:34 smithi172 bash[24902]: audit 2023-12-07T17:58:34.155242+0000 mon.smithi172 (mon.0) 922 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:58:34.829 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:35.830 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:35.842 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:35 smithi172 bash[24902]: cluster 2023-12-07T17:58:33.783709+0000 mgr.smithi172.nqsqxd (mgr.14199) 1977 : cluster 0 pgmap v1676: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:35.842 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:35 smithi172 bash[24902]: audit 2023-12-07T17:58:33.965181+0000 mgr.smithi172.nqsqxd (mgr.14199) 1978 : audit 0 from='client.15082 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:37.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:37 smithi172 bash[24902]: cluster 2023-12-07T17:58:35.784322+0000 mgr.smithi172.nqsqxd (mgr.14199) 1979 : cluster 0 pgmap v1677: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:39.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:39 smithi172 bash[24902]: cluster 2023-12-07T17:58:37.785062+0000 mgr.smithi172.nqsqxd (mgr.14199) 1980 : cluster 0 pgmap v1678: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:40.626 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:41.846 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:41 smithi172 bash[24902]: cluster 2023-12-07T17:58:39.785636+0000 mgr.smithi172.nqsqxd (mgr.14199) 1981 : cluster 0 pgmap v1679: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:43.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:43 smithi172 bash[24902]: cluster 2023-12-07T17:58:41.786447+0000 mgr.smithi172.nqsqxd (mgr.14199) 1982 : cluster 0 pgmap v1680: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:43.955 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:43.955 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:44.824 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:45.825 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:45.839 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:45 smithi172 bash[24902]: cluster 2023-12-07T17:58:43.787071+0000 mgr.smithi172.nqsqxd (mgr.14199) 1983 : cluster 0 pgmap v1681: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:45.839 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:45 smithi172 bash[24902]: audit 2023-12-07T17:58:43.941662+0000 mgr.smithi172.nqsqxd (mgr.14199) 1984 : audit 0 from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:47.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:47 smithi172 bash[24902]: cluster 2023-12-07T17:58:45.787760+0000 mgr.smithi172.nqsqxd (mgr.14199) 1985 : cluster 0 pgmap v1682: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:49 smithi172 bash[24902]: cluster 2023-12-07T17:58:47.788533+0000 mgr.smithi172.nqsqxd (mgr.14199) 1986 : cluster 0 pgmap v1683: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:49.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:49 smithi172 bash[24902]: audit 2023-12-07T17:58:49.155726+0000 mon.smithi172 (mon.0) 923 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:58:50.621 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:58:51.818 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:51 smithi172 bash[24902]: cluster 2023-12-07T17:58:49.789234+0000 mgr.smithi172.nqsqxd (mgr.14199) 1987 : cluster 0 pgmap v1684: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:53.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:53 smithi172 bash[24902]: cluster 2023-12-07T17:58:51.790084+0000 mgr.smithi172.nqsqxd (mgr.14199) 1988 : cluster 0 pgmap v1685: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:53.992 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:58:53.992 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:58:54.782 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:58:55.783 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:58:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:55 smithi172 bash[24902]: cluster 2023-12-07T17:58:53.790721+0000 mgr.smithi172.nqsqxd (mgr.14199) 1989 : cluster 0 pgmap v1686: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:55 smithi172 bash[24902]: audit 2023-12-07T17:58:53.978200+0000 mgr.smithi172.nqsqxd (mgr.14199) 1990 : audit 0 from='client.15086 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:58:57.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:57 smithi172 bash[24902]: cluster 2023-12-07T17:58:55.791394+0000 mgr.smithi172.nqsqxd (mgr.14199) 1991 : cluster 0 pgmap v1687: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:58:59.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:58:59 smithi172 bash[24902]: cluster 2023-12-07T17:58:57.792136+0000 mgr.smithi172.nqsqxd (mgr.14199) 1992 : cluster 0 pgmap v1688: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:00.584 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:01.838 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:01 smithi172 bash[24902]: cluster 2023-12-07T17:58:59.792815+0000 mgr.smithi172.nqsqxd (mgr.14199) 1993 : cluster 0 pgmap v1689: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:03.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:03 smithi172 bash[24902]: cluster 2023-12-07T17:59:01.793594+0000 mgr.smithi172.nqsqxd (mgr.14199) 1994 : cluster 0 pgmap v1690: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:04.023 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:04.023 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:04.841 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:04 smithi172 bash[24902]: audit 2023-12-07T17:59:04.155789+0000 mon.smithi172 (mon.0) 924 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:59:04.842 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:05.843 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:05.856 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:05 smithi172 bash[24902]: cluster 2023-12-07T17:59:03.794144+0000 mgr.smithi172.nqsqxd (mgr.14199) 1995 : cluster 0 pgmap v1691: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:05.856 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:05 smithi172 bash[24902]: audit 2023-12-07T17:59:04.007759+0000 mgr.smithi172.nqsqxd (mgr.14199) 1996 : audit 0 from='client.15088 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:07.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:07 smithi172 bash[24902]: cluster 2023-12-07T17:59:05.794786+0000 mgr.smithi172.nqsqxd (mgr.14199) 1997 : cluster 0 pgmap v1692: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:09.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:09 smithi172 bash[24902]: cluster 2023-12-07T17:59:07.795756+0000 mgr.smithi172.nqsqxd (mgr.14199) 1998 : cluster 0 pgmap v1693: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:10.647 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:11.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:11 smithi172 bash[24902]: cluster 2023-12-07T17:59:09.796437+0000 mgr.smithi172.nqsqxd (mgr.14199) 1999 : cluster 0 pgmap v1694: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:13.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:13 smithi172 bash[24902]: cluster 2023-12-07T17:59:11.797247+0000 mgr.smithi172.nqsqxd (mgr.14199) 2000 : cluster 0 pgmap v1695: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:13.952 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:13.952 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:14.790 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:15.791 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:15 smithi172 bash[24902]: cluster 2023-12-07T17:59:13.797877+0000 mgr.smithi172.nqsqxd (mgr.14199) 2001 : cluster 0 pgmap v1696: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:15 smithi172 bash[24902]: audit 2023-12-07T17:59:13.939297+0000 mgr.smithi172.nqsqxd (mgr.14199) 2002 : audit 0 from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:17.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:17 smithi172 bash[24902]: cluster 2023-12-07T17:59:15.798695+0000 mgr.smithi172.nqsqxd (mgr.14199) 2003 : cluster 0 pgmap v1697: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:19 smithi172 bash[24902]: cluster 2023-12-07T17:59:17.799506+0000 mgr.smithi172.nqsqxd (mgr.14199) 2004 : cluster 0 pgmap v1698: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:19 smithi172 bash[24902]: audit 2023-12-07T17:59:19.156368+0000 mon.smithi172 (mon.0) 925 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:59:20.581 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:21.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:21 smithi172 bash[24902]: cluster 2023-12-07T17:59:19.800239+0000 mgr.smithi172.nqsqxd (mgr.14199) 2005 : cluster 0 pgmap v1699: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:23.816 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:23.817 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:23.870 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:23 smithi172 bash[24902]: cluster 2023-12-07T17:59:21.801186+0000 mgr.smithi172.nqsqxd (mgr.14199) 2006 : cluster 0 pgmap v1700: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:24.622 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:25.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:25 smithi172 bash[24902]: audit 2023-12-07T17:59:23.801381+0000 mgr.smithi172.nqsqxd (mgr.14199) 2007 : audit 0 from='client.15092 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:25.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:25 smithi172 bash[24902]: cluster 2023-12-07T17:59:23.801944+0000 mgr.smithi172.nqsqxd (mgr.14199) 2008 : cluster 0 pgmap v1701: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:26 smithi172 bash[24902]: audit 2023-12-07T17:59:25.835245+0000 mon.smithi172 (mon.0) 926 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T17:59:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:26 smithi172 bash[24902]: audit 2023-12-07T17:59:26.408413+0000 mon.smithi172 (mon.0) 927 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T17:59:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:26 smithi172 bash[24902]: audit 2023-12-07T17:59:26.410200+0000 mon.smithi172 (mon.0) 928 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T17:59:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:26 smithi172 bash[24902]: audit 2023-12-07T17:59:26.418318+0000 mon.smithi172 (mon.0) 929 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T17:59:27.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:27 smithi172 bash[24902]: cluster 2023-12-07T17:59:25.802544+0000 mgr.smithi172.nqsqxd (mgr.14199) 2009 : cluster 0 pgmap v1702: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:27.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:27 smithi172 bash[24902]: cluster 2023-12-07T17:59:26.413072+0000 mgr.smithi172.nqsqxd (mgr.14199) 2010 : cluster 0 pgmap v1703: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:27.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:27 smithi172 bash[24902]: cluster 2023-12-07T17:59:26.413609+0000 mgr.smithi172.nqsqxd (mgr.14199) 2011 : cluster 0 pgmap v1704: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:29.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:29 smithi172 bash[24902]: cluster 2023-12-07T17:59:28.414287+0000 mgr.smithi172.nqsqxd (mgr.14199) 2012 : cluster 0 pgmap v1705: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:30.419 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:31.746 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:31 smithi172 bash[24902]: cluster 2023-12-07T17:59:30.414956+0000 mgr.smithi172.nqsqxd (mgr.14199) 2013 : cluster 0 pgmap v1706: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:33.834 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:33.834 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:33.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:33 smithi172 bash[24902]: cluster 2023-12-07T17:59:32.415864+0000 mgr.smithi172.nqsqxd (mgr.14199) 2014 : cluster 0 pgmap v1707: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:34.657 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:34 smithi172 bash[24902]: audit 2023-12-07T17:59:34.156184+0000 mon.smithi172 (mon.0) 930 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:59:35.658 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:36.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:35 smithi172 bash[24902]: audit 2023-12-07T17:59:33.823714+0000 mgr.smithi172.nqsqxd (mgr.14199) 2015 : audit 0 from='client.15094 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:36.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:35 smithi172 bash[24902]: cluster 2023-12-07T17:59:34.416299+0000 mgr.smithi172.nqsqxd (mgr.14199) 2016 : cluster 0 pgmap v1708: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:38.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:37 smithi172 bash[24902]: cluster 2023-12-07T17:59:36.417086+0000 mgr.smithi172.nqsqxd (mgr.14199) 2017 : cluster 0 pgmap v1709: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:40.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:39 smithi172 bash[24902]: cluster 2023-12-07T17:59:38.417712+0000 mgr.smithi172.nqsqxd (mgr.14199) 2018 : cluster 0 pgmap v1710: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:40.456 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:41.702 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:41 smithi172 bash[24902]: cluster 2023-12-07T17:59:40.418395+0000 mgr.smithi172.nqsqxd (mgr.14199) 2019 : cluster 0 pgmap v1711: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:43.776 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:43.776 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:44.025 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:43 smithi172 bash[24902]: cluster 2023-12-07T17:59:42.419510+0000 mgr.smithi172.nqsqxd (mgr.14199) 2020 : cluster 0 pgmap v1712: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:44.591 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:44.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:44 smithi172 bash[24902]: audit 2023-12-07T17:59:43.760294+0000 mgr.smithi172.nqsqxd (mgr.14199) 2021 : audit 0 from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:45.591 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:45.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:45 smithi172 bash[24902]: cluster 2023-12-07T17:59:44.420252+0000 mgr.smithi172.nqsqxd (mgr.14199) 2022 : cluster 0 pgmap v1713: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:47.957 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:47 smithi172 bash[24902]: cluster 2023-12-07T17:59:46.421019+0000 mgr.smithi172.nqsqxd (mgr.14199) 2023 : cluster 0 pgmap v1714: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:50.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:49 smithi172 bash[24902]: cluster 2023-12-07T17:59:48.421620+0000 mgr.smithi172.nqsqxd (mgr.14199) 2024 : cluster 0 pgmap v1715: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:50.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:49 smithi172 bash[24902]: audit 2023-12-07T17:59:49.157217+0000 mon.smithi172 (mon.0) 931 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T17:59:50.394 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T17:59:52.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:51 smithi172 bash[24902]: cluster 2023-12-07T17:59:50.422185+0000 mgr.smithi172.nqsqxd (mgr.14199) 2025 : cluster 0 pgmap v1716: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:53.647 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T17:59:53.648 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T17:59:54.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:53 smithi172 bash[24902]: cluster 2023-12-07T17:59:52.423019+0000 mgr.smithi172.nqsqxd (mgr.14199) 2026 : cluster 0 pgmap v1717: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:54.483 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T17:59:54.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:54 smithi172 bash[24902]: audit 2023-12-07T17:59:53.637247+0000 mgr.smithi172.nqsqxd (mgr.14199) 2027 : audit 0 from='client.15098 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T17:59:55.484 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T17:59:55.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:55 smithi172 bash[24902]: cluster 2023-12-07T17:59:54.423806+0000 mgr.smithi172.nqsqxd (mgr.14199) 2028 : cluster 0 pgmap v1718: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T17:59:58.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:57 smithi172 bash[24902]: cluster 2023-12-07T17:59:56.424606+0000 mgr.smithi172.nqsqxd (mgr.14199) 2029 : cluster 0 pgmap v1719: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:00.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 17:59:59 smithi172 bash[24902]: cluster 2023-12-07T17:59:58.425271+0000 mgr.smithi172.nqsqxd (mgr.14199) 2030 : cluster 0 pgmap v1720: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:00.279 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:02.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:01 smithi172 bash[24902]: cluster 2023-12-07T18:00:00.425912+0000 mgr.smithi172.nqsqxd (mgr.14199) 2031 : cluster 0 pgmap v1721: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:03.645 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:03.645 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:04.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:03 smithi172 bash[24902]: cluster 2023-12-07T18:00:02.426750+0000 mgr.smithi172.nqsqxd (mgr.14199) 2032 : cluster 0 pgmap v1722: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:04.484 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:04 smithi172 bash[24902]: audit 2023-12-07T18:00:03.628732+0000 mgr.smithi172.nqsqxd (mgr.14199) 2033 : audit 0 from='client.15100 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:04.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:04 smithi172 bash[24902]: audit 2023-12-07T18:00:04.157033+0000 mon.smithi172 (mon.0) 932 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:00:05.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:05.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:05 smithi172 bash[24902]: cluster 2023-12-07T18:00:04.427240+0000 mgr.smithi172.nqsqxd (mgr.14199) 2034 : cluster 0 pgmap v1723: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:08.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:07 smithi172 bash[24902]: cluster 2023-12-07T18:00:06.428043+0000 mgr.smithi172.nqsqxd (mgr.14199) 2035 : cluster 0 pgmap v1724: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:10.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:09 smithi172 bash[24902]: cluster 2023-12-07T18:00:08.428669+0000 mgr.smithi172.nqsqxd (mgr.14199) 2036 : cluster 0 pgmap v1725: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:10.279 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:12.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:11 smithi172 bash[24902]: cluster 2023-12-07T18:00:10.429443+0000 mgr.smithi172.nqsqxd (mgr.14199) 2037 : cluster 0 pgmap v1726: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:13.729 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:13.729 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:13.960 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:13 smithi172 bash[24902]: cluster 2023-12-07T18:00:12.430103+0000 mgr.smithi172.nqsqxd (mgr.14199) 2038 : cluster 0 pgmap v1727: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:14.527 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:14.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:14 smithi172 bash[24902]: audit 2023-12-07T18:00:13.715519+0000 mgr.smithi172.nqsqxd (mgr.14199) 2039 : audit 0 from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:15.528 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:15.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:15 smithi172 bash[24902]: cluster 2023-12-07T18:00:14.430796+0000 mgr.smithi172.nqsqxd (mgr.14199) 2040 : cluster 0 pgmap v1728: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:18.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:17 smithi172 bash[24902]: cluster 2023-12-07T18:00:16.431542+0000 mgr.smithi172.nqsqxd (mgr.14199) 2041 : cluster 0 pgmap v1729: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:20.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:19 smithi172 bash[24902]: cluster 2023-12-07T18:00:18.432239+0000 mgr.smithi172.nqsqxd (mgr.14199) 2042 : cluster 0 pgmap v1730: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:20.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:19 smithi172 bash[24902]: audit 2023-12-07T18:00:19.158009+0000 mon.smithi172 (mon.0) 933 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:00:20.321 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:22.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:21 smithi172 bash[24902]: cluster 2023-12-07T18:00:20.432945+0000 mgr.smithi172.nqsqxd (mgr.14199) 2043 : cluster 0 pgmap v1731: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:23.577 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:23.577 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:23.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:23 smithi172 bash[24902]: cluster 2023-12-07T18:00:22.433909+0000 mgr.smithi172.nqsqxd (mgr.14199) 2044 : cluster 0 pgmap v1732: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:24.337 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:24 smithi172 bash[24902]: audit 2023-12-07T18:00:23.561918+0000 mgr.smithi172.nqsqxd (mgr.14199) 2045 : audit 0 from='client.15104 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:25.338 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:26.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:25 smithi172 bash[24902]: cluster 2023-12-07T18:00:24.434570+0000 mgr.smithi172.nqsqxd (mgr.14199) 2046 : cluster 0 pgmap v1733: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:27.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:26 smithi172 bash[24902]: audit 2023-12-07T18:00:26.470060+0000 mon.smithi172 (mon.0) 934 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T18:00:28.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:27 smithi172 bash[24902]: cluster 2023-12-07T18:00:26.435364+0000 mgr.smithi172.nqsqxd (mgr.14199) 2047 : cluster 0 pgmap v1734: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:28.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:27 smithi172 bash[24902]: audit 2023-12-07T18:00:27.043296+0000 mon.smithi172 (mon.0) 935 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T18:00:28.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:27 smithi172 bash[24902]: audit 2023-12-07T18:00:27.044737+0000 mon.smithi172 (mon.0) 936 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T18:00:28.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:27 smithi172 bash[24902]: audit 2023-12-07T18:00:27.051314+0000 mon.smithi172 (mon.0) 937 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T18:00:29.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:28 smithi172 bash[24902]: cluster 2023-12-07T18:00:27.046807+0000 mgr.smithi172.nqsqxd (mgr.14199) 2048 : cluster 0 pgmap v1735: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:29.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:28 smithi172 bash[24902]: cluster 2023-12-07T18:00:27.046988+0000 mgr.smithi172.nqsqxd (mgr.14199) 2049 : cluster 0 pgmap v1736: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:30.139 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:31.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:30 smithi172 bash[24902]: cluster 2023-12-07T18:00:29.047538+0000 mgr.smithi172.nqsqxd (mgr.14199) 2050 : cluster 0 pgmap v1737: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:33.103 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:32 smithi172 bash[24902]: cluster 2023-12-07T18:00:31.048229+0000 mgr.smithi172.nqsqxd (mgr.14199) 2051 : cluster 0 pgmap v1738: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:33.544 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:33.544 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:34.419 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:35.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:34 smithi172 bash[24902]: cluster 2023-12-07T18:00:33.049036+0000 mgr.smithi172.nqsqxd (mgr.14199) 2052 : cluster 0 pgmap v1739: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:35.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:34 smithi172 bash[24902]: audit 2023-12-07T18:00:33.531019+0000 mgr.smithi172.nqsqxd (mgr.14199) 2053 : audit 0 from='client.15106 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:35.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:34 smithi172 bash[24902]: audit 2023-12-07T18:00:34.157923+0000 mon.smithi172 (mon.0) 938 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:00:35.420 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:37.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:36 smithi172 bash[24902]: cluster 2023-12-07T18:00:35.049689+0000 mgr.smithi172.nqsqxd (mgr.14199) 2054 : cluster 0 pgmap v1740: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:39.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:38 smithi172 bash[24902]: cluster 2023-12-07T18:00:37.050636+0000 mgr.smithi172.nqsqxd (mgr.14199) 2055 : cluster 0 pgmap v1741: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:40.214 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:41.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:40 smithi172 bash[24902]: cluster 2023-12-07T18:00:39.051260+0000 mgr.smithi172.nqsqxd (mgr.14199) 2056 : cluster 0 pgmap v1742: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:43.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:42 smithi172 bash[24902]: cluster 2023-12-07T18:00:41.051997+0000 mgr.smithi172.nqsqxd (mgr.14199) 2057 : cluster 0 pgmap v1743: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:43.281 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:43.282 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:44.052 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:45.053 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:45.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:44 smithi172 bash[24902]: cluster 2023-12-07T18:00:43.052452+0000 mgr.smithi172.nqsqxd (mgr.14199) 2058 : cluster 0 pgmap v1744: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:45.065 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:44 smithi172 bash[24902]: audit 2023-12-07T18:00:43.268089+0000 mgr.smithi172.nqsqxd (mgr.14199) 2059 : audit 0 from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:47.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:46 smithi172 bash[24902]: cluster 2023-12-07T18:00:45.053002+0000 mgr.smithi172.nqsqxd (mgr.14199) 2060 : cluster 0 pgmap v1745: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:49.056 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:48 smithi172 bash[24902]: cluster 2023-12-07T18:00:47.053821+0000 mgr.smithi172.nqsqxd (mgr.14199) 2061 : cluster 0 pgmap v1746: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:49.843 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:00:50.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:49 smithi172 bash[24902]: audit 2023-12-07T18:00:49.158638+0000 mon.smithi172 (mon.0) 939 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:00:51.109 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:50 smithi172 bash[24902]: cluster 2023-12-07T18:00:49.054446+0000 mgr.smithi172.nqsqxd (mgr.14199) 2062 : cluster 0 pgmap v1747: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:52.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:52 smithi172 bash[24902]: cluster 2023-12-07T18:00:51.054959+0000 mgr.smithi172.nqsqxd (mgr.14199) 2063 : cluster 0 pgmap v1748: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:53.032 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:00:53.032 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:00:53.797 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:00:54.798 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:00:55.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:54 smithi172 bash[24902]: audit 2023-12-07T18:00:53.018844+0000 mgr.smithi172.nqsqxd (mgr.14199) 2064 : audit 0 from='client.15110 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:00:55.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:54 smithi172 bash[24902]: cluster 2023-12-07T18:00:53.055481+0000 mgr.smithi172.nqsqxd (mgr.14199) 2065 : cluster 0 pgmap v1749: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:57.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:56 smithi172 bash[24902]: cluster 2023-12-07T18:00:55.056039+0000 mgr.smithi172.nqsqxd (mgr.14199) 2066 : cluster 0 pgmap v1750: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:59.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:00:58 smithi172 bash[24902]: cluster 2023-12-07T18:00:57.056785+0000 mgr.smithi172.nqsqxd (mgr.14199) 2067 : cluster 0 pgmap v1751: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:00:59.588 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:01.044 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:00 smithi172 bash[24902]: cluster 2023-12-07T18:00:59.057480+0000 mgr.smithi172.nqsqxd (mgr.14199) 2068 : cluster 0 pgmap v1752: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:02.978 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:02.978 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:03.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:02 smithi172 bash[24902]: cluster 2023-12-07T18:01:01.058069+0000 mgr.smithi172.nqsqxd (mgr.14199) 2069 : cluster 0 pgmap v1753: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:03.807 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:04.808 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:04 smithi172 bash[24902]: audit 2023-12-07T18:01:02.968110+0000 mgr.smithi172.nqsqxd (mgr.14199) 2070 : audit 0 from='client.15112 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:04 smithi172 bash[24902]: cluster 2023-12-07T18:01:03.058540+0000 mgr.smithi172.nqsqxd (mgr.14199) 2071 : cluster 0 pgmap v1754: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:04 smithi172 bash[24902]: audit 2023-12-07T18:01:04.159257+0000 mon.smithi172 (mon.0) 940 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:01:07.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:06 smithi172 bash[24902]: cluster 2023-12-07T18:01:05.059130+0000 mgr.smithi172.nqsqxd (mgr.14199) 2072 : cluster 0 pgmap v1755: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:09.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:08 smithi172 bash[24902]: cluster 2023-12-07T18:01:07.059828+0000 mgr.smithi172.nqsqxd (mgr.14199) 2073 : cluster 0 pgmap v1756: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:09.607 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:11.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:10 smithi172 bash[24902]: cluster 2023-12-07T18:01:09.060418+0000 mgr.smithi172.nqsqxd (mgr.14199) 2074 : cluster 0 pgmap v1757: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:12.809 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:12.809 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:13.042 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:12 smithi172 bash[24902]: cluster 2023-12-07T18:01:11.061075+0000 mgr.smithi172.nqsqxd (mgr.14199) 2075 : cluster 0 pgmap v1758: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:13.568 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:13.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:13 smithi172 bash[24902]: audit 2023-12-07T18:01:12.794654+0000 mgr.smithi172.nqsqxd (mgr.14199) 2076 : audit 0 from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:14.569 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:14 smithi172 bash[24902]: cluster 2023-12-07T18:01:13.061772+0000 mgr.smithi172.nqsqxd (mgr.14199) 2077 : cluster 0 pgmap v1759: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:17.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:16 smithi172 bash[24902]: cluster 2023-12-07T18:01:15.062373+0000 mgr.smithi172.nqsqxd (mgr.14199) 2078 : cluster 0 pgmap v1760: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:19.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:18 smithi172 bash[24902]: cluster 2023-12-07T18:01:17.063153+0000 mgr.smithi172.nqsqxd (mgr.14199) 2079 : cluster 0 pgmap v1761: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:19.364 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:20.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:19 smithi172 bash[24902]: audit 2023-12-07T18:01:19.159652+0000 mon.smithi172 (mon.0) 941 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:01:21.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:20 smithi172 bash[24902]: cluster 2023-12-07T18:01:19.063783+0000 mgr.smithi172.nqsqxd (mgr.14199) 2080 : cluster 0 pgmap v1762: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:22.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:21 smithi172 bash[24902]: cluster 2023-12-07T18:01:21.064275+0000 mgr.smithi172.nqsqxd (mgr.14199) 2081 : cluster 0 pgmap v1763: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:22.654 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:22.654 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:23.427 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:23.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:23 smithi172 bash[24902]: audit 2023-12-07T18:01:22.640827+0000 mgr.smithi172.nqsqxd (mgr.14199) 2082 : audit 0 from='client.15116 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:24.428 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:24.726 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:24 smithi172 bash[24902]: cluster 2023-12-07T18:01:23.064999+0000 mgr.smithi172.nqsqxd (mgr.14199) 2083 : cluster 0 pgmap v1764: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:26.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:26 smithi172 bash[24902]: cluster 2023-12-07T18:01:25.065641+0000 mgr.smithi172.nqsqxd (mgr.14199) 2084 : cluster 0 pgmap v1765: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:27.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:27 smithi172 bash[24902]: audit 2023-12-07T18:01:27.102275+0000 mon.smithi172 (mon.0) 942 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T18:01:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: cluster 2023-12-07T18:01:27.066493+0000 mgr.smithi172.nqsqxd (mgr.14199) 2085 : cluster 0 pgmap v1766: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: audit 2023-12-07T18:01:27.726101+0000 mon.smithi172 (mon.0) 943 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T18:01:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: audit 2023-12-07T18:01:27.727701+0000 mon.smithi172 (mon.0) 944 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T18:01:28.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: cluster 2023-12-07T18:01:27.730074+0000 mgr.smithi172.nqsqxd (mgr.14199) 2086 : cluster 0 pgmap v1767: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:28.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: cluster 2023-12-07T18:01:27.730448+0000 mgr.smithi172.nqsqxd (mgr.14199) 2087 : cluster 0 pgmap v1768: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:28.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:28 smithi172 bash[24902]: audit 2023-12-07T18:01:27.736278+0000 mon.smithi172 (mon.0) 945 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T18:01:29.211 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:31.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:30 smithi172 bash[24902]: cluster 2023-12-07T18:01:29.731079+0000 mgr.smithi172.nqsqxd (mgr.14199) 2088 : cluster 0 pgmap v1769: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:32.722 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:32.723 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:33.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:32 smithi172 bash[24902]: cluster 2023-12-07T18:01:31.731578+0000 mgr.smithi172.nqsqxd (mgr.14199) 2089 : cluster 0 pgmap v1770: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:33.503 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:34.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:33 smithi172 bash[24902]: audit 2023-12-07T18:01:32.707411+0000 mgr.smithi172.nqsqxd (mgr.14199) 2090 : audit 0 from='client.15118 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:34.504 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:35.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:34 smithi172 bash[24902]: cluster 2023-12-07T18:01:33.732201+0000 mgr.smithi172.nqsqxd (mgr.14199) 2091 : cluster 0 pgmap v1771: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:35.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:34 smithi172 bash[24902]: audit 2023-12-07T18:01:34.160013+0000 mon.smithi172 (mon.0) 946 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:01:37.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:36 smithi172 bash[24902]: cluster 2023-12-07T18:01:35.732718+0000 mgr.smithi172.nqsqxd (mgr.14199) 2092 : cluster 0 pgmap v1772: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:38.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:38 smithi172 bash[24902]: cluster 2023-12-07T18:01:37.733613+0000 mgr.smithi172.nqsqxd (mgr.14199) 2093 : cluster 0 pgmap v1773: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:39.307 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:41.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:40 smithi172 bash[24902]: cluster 2023-12-07T18:01:39.734272+0000 mgr.smithi172.nqsqxd (mgr.14199) 2094 : cluster 0 pgmap v1774: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:42.717 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:42.717 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:43.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:42 smithi172 bash[24902]: cluster 2023-12-07T18:01:41.735097+0000 mgr.smithi172.nqsqxd (mgr.14199) 2095 : cluster 0 pgmap v1775: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:43.535 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:44.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:43 smithi172 bash[24902]: audit 2023-12-07T18:01:42.701985+0000 mgr.smithi172.nqsqxd (mgr.14199) 2096 : audit 0 from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:44.537 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:45.087 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:44 smithi172 bash[24902]: cluster 2023-12-07T18:01:43.735768+0000 mgr.smithi172.nqsqxd (mgr.14199) 2097 : cluster 0 pgmap v1776: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:47.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:46 smithi172 bash[24902]: cluster 2023-12-07T18:01:45.736468+0000 mgr.smithi172.nqsqxd (mgr.14199) 2098 : cluster 0 pgmap v1777: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:48.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:48 smithi172 bash[24902]: cluster 2023-12-07T18:01:47.737272+0000 mgr.smithi172.nqsqxd (mgr.14199) 2099 : cluster 0 pgmap v1778: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:49.325 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:01:49.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:49 smithi172 bash[24902]: audit 2023-12-07T18:01:49.160403+0000 mon.smithi172 (mon.0) 947 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:01:50.869 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:50 smithi172 bash[24902]: cluster 2023-12-07T18:01:49.737932+0000 mgr.smithi172.nqsqxd (mgr.14199) 2100 : cluster 0 pgmap v1779: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:52.827 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:01:52.827 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:01:53.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:52 smithi172 bash[24902]: cluster 2023-12-07T18:01:51.738772+0000 mgr.smithi172.nqsqxd (mgr.14199) 2101 : cluster 0 pgmap v1780: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:53.666 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:01:54.667 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:01:55.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:54 smithi172 bash[24902]: audit 2023-12-07T18:01:52.810971+0000 mgr.smithi172.nqsqxd (mgr.14199) 2102 : audit 0 from='client.15122 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:01:55.131 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:54 smithi172 bash[24902]: cluster 2023-12-07T18:01:53.739412+0000 mgr.smithi172.nqsqxd (mgr.14199) 2103 : cluster 0 pgmap v1781: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:57.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:56 smithi172 bash[24902]: cluster 2023-12-07T18:01:55.740084+0000 mgr.smithi172.nqsqxd (mgr.14199) 2104 : cluster 0 pgmap v1782: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:58.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:01:58 smithi172 bash[24902]: cluster 2023-12-07T18:01:57.740937+0000 mgr.smithi172.nqsqxd (mgr.14199) 2105 : cluster 0 pgmap v1783: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:01:59.462 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:02:01.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:00 smithi172 bash[24902]: cluster 2023-12-07T18:01:59.741658+0000 mgr.smithi172.nqsqxd (mgr.14199) 2106 : cluster 0 pgmap v1784: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:02.613 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:02:02.613 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:02:03.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:02 smithi172 bash[24902]: cluster 2023-12-07T18:02:01.742515+0000 mgr.smithi172.nqsqxd (mgr.14199) 2107 : cluster 0 pgmap v1785: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:03.394 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:02:04.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:03 smithi172 bash[24902]: audit 2023-12-07T18:02:02.599700+0000 mgr.smithi172.nqsqxd (mgr.14199) 2108 : audit 0 from='client.15124 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:02:04.395 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:02:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:04 smithi172 bash[24902]: cluster 2023-12-07T18:02:03.743164+0000 mgr.smithi172.nqsqxd (mgr.14199) 2109 : cluster 0 pgmap v1786: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:05.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:04 smithi172 bash[24902]: audit 2023-12-07T18:02:04.160810+0000 mon.smithi172 (mon.0) 948 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:02:06.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:05 smithi172 bash[24902]: cluster 2023-12-07T18:02:05.743809+0000 mgr.smithi172.nqsqxd (mgr.14199) 2110 : cluster 0 pgmap v1787: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:08.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:08 smithi172 bash[24902]: cluster 2023-12-07T18:02:07.744624+0000 mgr.smithi172.nqsqxd (mgr.14199) 2111 : cluster 0 pgmap v1788: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:09.190 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:02:10.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:10 smithi172 bash[24902]: cluster 2023-12-07T18:02:09.745246+0000 mgr.smithi172.nqsqxd (mgr.14199) 2112 : cluster 0 pgmap v1789: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:12.783 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:02:12.783 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:02:13.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:12 smithi172 bash[24902]: cluster 2023-12-07T18:02:11.746027+0000 mgr.smithi172.nqsqxd (mgr.14199) 2113 : cluster 0 pgmap v1790: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:13.665 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:02:14.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:13 smithi172 bash[24902]: audit 2023-12-07T18:02:12.770832+0000 mgr.smithi172.nqsqxd (mgr.14199) 2114 : audit 0 from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:02:14.666 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:02:15.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:14 smithi172 bash[24902]: cluster 2023-12-07T18:02:13.746720+0000 mgr.smithi172.nqsqxd (mgr.14199) 2115 : cluster 0 pgmap v1791: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:17.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:16 smithi172 bash[24902]: cluster 2023-12-07T18:02:15.747378+0000 mgr.smithi172.nqsqxd (mgr.14199) 2116 : cluster 0 pgmap v1792: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:18.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:18 smithi172 bash[24902]: cluster 2023-12-07T18:02:17.748215+0000 mgr.smithi172.nqsqxd (mgr.14199) 2117 : cluster 0 pgmap v1793: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:19.463 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:02:19.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:19 smithi172 bash[24902]: audit 2023-12-07T18:02:19.161430+0000 mon.smithi172 (mon.0) 949 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:02:20.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:20 smithi172 bash[24902]: cluster 2023-12-07T18:02:19.748851+0000 mgr.smithi172.nqsqxd (mgr.14199) 2118 : cluster 0 pgmap v1794: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:22.904 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:02:22.905 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:02:23.121 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:22 smithi172 bash[24902]: cluster 2023-12-07T18:02:21.749445+0000 mgr.smithi172.nqsqxd (mgr.14199) 2119 : cluster 0 pgmap v1795: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:23.697 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:02:24.698 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:02:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:24 smithi172 bash[24902]: audit 2023-12-07T18:02:22.889655+0000 mgr.smithi172.nqsqxd (mgr.14199) 2120 : audit 0 from='client.15128 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:02:25.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:24 smithi172 bash[24902]: cluster 2023-12-07T18:02:23.750063+0000 mgr.smithi172.nqsqxd (mgr.14199) 2121 : cluster 0 pgmap v1796: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:27.130 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:26 smithi172 bash[24902]: cluster 2023-12-07T18:02:25.750752+0000 mgr.smithi172.nqsqxd (mgr.14199) 2122 : cluster 0 pgmap v1797: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:28 smithi172 bash[24902]: cluster 2023-12-07T18:02:27.751513+0000 mgr.smithi172.nqsqxd (mgr.14199) 2123 : cluster 0 pgmap v1798: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:28 smithi172 bash[24902]: audit 2023-12-07T18:02:27.787739+0000 mon.smithi172 (mon.0) 950 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-07T18:02:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:28 smithi172 bash[24902]: audit 2023-12-07T18:02:28.360154+0000 mon.smithi172 (mon.0) 951 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-07T18:02:28.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:28 smithi172 bash[24902]: audit 2023-12-07T18:02:28.362021+0000 mon.smithi172 (mon.0) 952 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-07T18:02:28.881 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:28 smithi172 bash[24902]: audit 2023-12-07T18:02:28.368708+0000 mon.smithi172 (mon.0) 953 : audit 1 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' 2023-12-07T18:02:29.487 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:02:29.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:29 smithi172 bash[24902]: cluster 2023-12-07T18:02:28.364548+0000 mgr.smithi172.nqsqxd (mgr.14199) 2124 : cluster 0 pgmap v1799: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:29.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:29 smithi172 bash[24902]: cluster 2023-12-07T18:02:28.365020+0000 mgr.smithi172.nqsqxd (mgr.14199) 2125 : cluster 0 pgmap v1800: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:31.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:31 smithi172 bash[24902]: cluster 2023-12-07T18:02:30.365650+0000 mgr.smithi172.nqsqxd (mgr.14199) 2126 : cluster 0 pgmap v1801: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:32.750 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:02:32.751 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:02:33.530 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:02:33.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:33 smithi172 bash[24902]: cluster 2023-12-07T18:02:32.366434+0000 mgr.smithi172.nqsqxd (mgr.14199) 2127 : cluster 0 pgmap v1802: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:33.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:33 smithi172 bash[24902]: audit 2023-12-07T18:02:32.740738+0000 mgr.smithi172.nqsqxd (mgr.14199) 2128 : audit 0 from='client.15130 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-07T18:02:34.531 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e068ebcf7ecc6503f24666fb6b152034d3fe1067 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4fe67048-9522-11ee-95a2-87774f69a715 -- ceph orch ls -f json 2023-12-07T18:02:34.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:34 smithi172 bash[24902]: audit 2023-12-07T18:02:34.161799+0000 mon.smithi172 (mon.0) 954 : audit 0 from='mgr.14199 172.21.15.172:0/245421782' entity='mgr.smithi172.nqsqxd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2023-12-07T18:02:35.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:35 smithi172 bash[24902]: cluster 2023-12-07T18:02:34.367064+0000 mgr.smithi172.nqsqxd (mgr.14199) 2129 : cluster 0 pgmap v1803: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:37.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:37 smithi172 bash[24902]: cluster 2023-12-07T18:02:36.367901+0000 mgr.smithi172.nqsqxd (mgr.14199) 2130 : cluster 0 pgmap v1804: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:39.331 INFO:teuthology.orchestra.run.smithi172.stderr:Inferring config /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/mon.smithi172/config 2023-12-07T18:02:39.630 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:39 smithi172 bash[24902]: cluster 2023-12-07T18:02:38.368576+0000 mgr.smithi172.nqsqxd (mgr.14199) 2131 : cluster 0 pgmap v1805: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:41.880 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:41 smithi172 bash[24902]: cluster 2023-12-07T18:02:40.369443+0000 mgr.smithi172.nqsqxd (mgr.14199) 2132 : cluster 0 pgmap v1806: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:42.883 INFO:teuthology.orchestra.run.smithi172.stdout: 2023-12-07T18:02:42.883 INFO:teuthology.orchestra.run.smithi172.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2023-12-07T17:04:00.454580Z", "last_refresh": "2023-12-07T17:56:23.761003Z", "ports": [9093, 9094], "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "ceph-exporter", "service_type": "ceph-exporter", "spec": {"prio_limit": 5, "stats_period": 5}, "status": {"created": "2023-12-07T17:03:51.446695Z", "last_refresh": "2023-12-07T17:56:23.760166Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2023-12-07T17:03:49.285204Z", "last_refresh": "2023-12-07T17:56:23.760448Z", "running": 1, "size": 1}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "spec": {"anonymous_access": true, "protocol": "https"}, "status": {"created": "2023-12-07T17:03:55.742209Z", "last_refresh": "2023-12-07T17:56:23.761281Z", "ports": [3000], "running": 1, "size": 1}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2023-12-07T17:03:47.165493Z", "last_refresh": "2023-12-07T17:56:23.759880Z", "running": 2, "size": 2}}, {"events": ["2023-12-07T17:05:57.621010Z service:mon [INFO] \"service was created\""], "placement": {"count": 1, "hosts": ["smithi172:172.21.15.172=smithi172"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2023-12-07T17:05:26.912771Z", "last_refresh": "2023-12-07T17:56:23.759550Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2023-12-07T17:03:57.803301Z", "last_refresh": "2023-12-07T17:56:23.760726Z", "ports": [9100], "running": 1, "size": 1}}, {"service_name": "osd", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "e71bc55fd8bb7312113b93709199b3046fb27a1249ab2ff38e9d4fb4046d0412", "container_image_name": "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:f77e76429b2f90f995fd0b15e8ce2605700ed2a51f2d75623215c9aaf74f90b6", "last_refresh": "2023-12-07T17:56:23.762112Z", "running": 4, "size": 4}, "unmanaged": true}, {"events": ["2023-12-07T17:05:57.630890Z service:prometheus [INFO] \"service was created\""], "placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2023-12-07T17:03:53.602279Z", "last_refresh": "2023-12-07T17:56:23.761836Z", "ports": [9095], "running": 1, "size": 1}}, {"events": ["2023-12-07T17:12:42.296140Z service:rgw.foo [INFO] \"service was created\""], "placement": {"count_per_host": 4, "host_pattern": "*"}, "service_id": "foo", "service_name": "rgw.foo", "service_type": "rgw", "spec": {"rgw_frontend_port": 8000}, "status": {"created": "2023-12-07T17:12:42.289611Z", "last_refresh": "2023-12-07T17:56:23.763148Z", "ports": [8000], "running": 0, "size": 4}}] 2023-12-07T18:02:43.707 INFO:tasks.cephadm:rgw.foo has 0/4 2023-12-07T18:02:43.707 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e068ebcf7ecc6503f24666fb6b152034d3fe1067/qa/tasks/cephadm.py", line 1412, in wait_for_service while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (301) after waiting for 300 seconds 2023-12-07T18:02:43.772 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=99106944716249bcb64427549366372e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e068ebcf7ecc6503f24666fb6b152034d3fe1067/qa/tasks/cephadm.py", line 1412, in wait_for_service while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (301) after waiting for 300 seconds 2023-12-07T18:02:43.774 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-07T18:02:43.784 INFO:tasks.cephadm:Teardown begin 2023-12-07T18:02:43.784 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T18:02:43.808 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:43 smithi172 bash[24902]: cluster 2023-12-07T18:02:42.370067+0000 mgr.smithi172.nqsqxd (mgr.14199) 2133 : cluster 0 pgmap v1807: 33 pgs: 33 active+clean; 578 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-12-07T18:02:43.811 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-07T18:02:43.811 DEBUG:teuthology.orchestra.run.smithi172:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-07T18:02:43.861 INFO:tasks.cephadm:Stopping all daemons... 2023-12-07T18:02:43.862 INFO:tasks.cephadm.mon.smithi172:Stopping mon.smithi172... 2023-12-07T18:02:43.862 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172 2023-12-07T18:02:44.085 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:43 smithi172 systemd[1]: Stopping Ceph mon.smithi172 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T18:02:44.380 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:44 smithi172 bash[24902]: debug 2023-12-07T18:02:44.075+0000 7f2dc61a1700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.smithi172 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2023-12-07T18:02:44.380 INFO:journalctl@ceph.mon.smithi172.smithi172.stdout:Dec 07 18:02:44 smithi172 bash[24902]: debug 2023-12-07T18:02:44.075+0000 7f2dc61a1700 -1 mon.smithi172@0(leader) e1 *** Got Signal Terminated *** 2023-12-07T18:02:45.051 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@mon.smithi172.service' 2023-12-07T18:02:45.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T18:02:45.087 INFO:tasks.cephadm.mon.smithi172:Stopped mon.smithi172 2023-12-07T18:02:45.088 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-07T18:02:45.088 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.0 2023-12-07T18:02:45.630 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:45 smithi172 systemd[1]: Stopping Ceph osd.0 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T18:02:45.631 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:45 smithi172 bash[45807]: debug 2023-12-07T18:02:45.303+0000 7f4a3e142700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-12-07T18:02:45.631 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:45 smithi172 bash[45807]: debug 2023-12-07T18:02:45.303+0000 7f4a3e142700 -1 osd.0 33 *** Got signal Terminated *** 2023-12-07T18:02:45.631 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:45 smithi172 bash[45807]: debug 2023-12-07T18:02:45.303+0000 7f4a3e142700 -1 osd.0 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T18:02:51.584 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:51 smithi172 bash[177603]: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-0 2023-12-07T18:02:51.880 INFO:journalctl@ceph.osd.0.smithi172.stdout:Dec 07 18:02:51 smithi172 bash[177673]: Error response from daemon: No such container: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-0 2023-12-07T18:02:53.848 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.0.service' 2023-12-07T18:02:53.882 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T18:02:53.883 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-07T18:02:53.883 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-07T18:02:53.883 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.1 2023-12-07T18:02:54.101 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:02:53 smithi172 systemd[1]: Stopping Ceph osd.1 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T18:02:54.380 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:02:54 smithi172 bash[54595]: debug 2023-12-07T18:02:54.090+0000 7f844f3ec700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-12-07T18:02:54.381 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:02:54 smithi172 bash[54595]: debug 2023-12-07T18:02:54.090+0000 7f844f3ec700 -1 osd.1 33 *** Got signal Terminated *** 2023-12-07T18:02:54.381 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:02:54 smithi172 bash[54595]: debug 2023-12-07T18:02:54.090+0000 7f844f3ec700 -1 osd.1 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T18:03:00.627 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:03:00 smithi172 bash[177816]: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-1 2023-12-07T18:03:00.627 INFO:journalctl@ceph.osd.1.smithi172.stdout:Dec 07 18:03:00 smithi172 bash[177883]: Error response from daemon: No such container: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-1 2023-12-07T18:03:02.798 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.1.service' 2023-12-07T18:03:02.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T18:03:02.830 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-07T18:03:02.831 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-07T18:03:02.831 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.2 2023-12-07T18:03:03.130 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:02 smithi172 systemd[1]: Stopping Ceph osd.2 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T18:03:03.131 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:03 smithi172 bash[62244]: debug 2023-12-07T18:03:03.026+0000 7f2d2b0c6700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-12-07T18:03:03.131 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:03 smithi172 bash[62244]: debug 2023-12-07T18:03:03.026+0000 7f2d2b0c6700 -1 osd.2 33 *** Got signal Terminated *** 2023-12-07T18:03:03.131 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:03 smithi172 bash[62244]: debug 2023-12-07T18:03:03.026+0000 7f2d2b0c6700 -1 osd.2 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T18:03:09.557 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:09 smithi172 bash[178024]: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-2 2023-12-07T18:03:09.557 INFO:journalctl@ceph.osd.2.smithi172.stdout:Dec 07 18:03:09 smithi172 bash[178093]: Error response from daemon: No such container: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-2 2023-12-07T18:03:11.772 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.2.service' 2023-12-07T18:03:11.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T18:03:11.806 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-07T18:03:11.806 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-07T18:03:11.806 DEBUG:teuthology.orchestra.run.smithi172:> sudo systemctl stop ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.3 2023-12-07T18:03:12.025 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:11 smithi172 systemd[1]: Stopping Ceph osd.3 for 4fe67048-9522-11ee-95a2-87774f69a715... 2023-12-07T18:03:12.380 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:12 smithi172 bash[70563]: debug 2023-12-07T18:03:12.018+0000 7eff0300e700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2023-12-07T18:03:12.380 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:12 smithi172 bash[70563]: debug 2023-12-07T18:03:12.018+0000 7eff0300e700 -1 osd.3 33 *** Got signal Terminated *** 2023-12-07T18:03:12.381 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:12 smithi172 bash[70563]: debug 2023-12-07T18:03:12.018+0000 7eff0300e700 -1 osd.3 33 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-07T18:03:15.880 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:15 smithi172 bash[70563]: debug 2023-12-07T18:03:15.458+0000 7efeff609700 -1 osd.3 33 heartbeat_check: no reply from 172.21.15.172:6806 osd.0 since back 2023-12-07T18:02:49.352934+0000 front 2023-12-07T18:02:49.353151+0000 (oldest deadline 2023-12-07T18:03:14.652832+0000) 2023-12-07T18:03:16.880 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:16 smithi172 bash[70563]: debug 2023-12-07T18:03:16.458+0000 7efeff609700 -1 osd.3 33 heartbeat_check: no reply from 172.21.15.172:6806 osd.0 since back 2023-12-07T18:02:49.352934+0000 front 2023-12-07T18:02:49.353151+0000 (oldest deadline 2023-12-07T18:03:14.652832+0000) 2023-12-07T18:03:18.520 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:18 smithi172 bash[178234]: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-3 2023-12-07T18:03:18.520 INFO:journalctl@ceph.osd.3.smithi172.stdout:Dec 07 18:03:18 smithi172 bash[178304]: Error response from daemon: No such container: ceph-4fe67048-9522-11ee-95a2-87774f69a715-osd-3 2023-12-07T18:03:20.577 DEBUG:teuthology.orchestra.run.smithi172:> sudo pkill -f 'journalctl -f -n 0 -u ceph-4fe67048-9522-11ee-95a2-87774f69a715@osd.3.service' 2023-12-07T18:03:20.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-07T18:03:20.617 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-07T18:03:20.617 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4fe67048-9522-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-07T18:03:20.825 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T18:03:38.305 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-07T18:03:38.317 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-07T18:03:38.319 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167/remote/smithi172/crash 2023-12-07T18:03:38.320 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/crash -- . 2023-12-07T18:03:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:tar: /var/lib/ceph/4fe67048-9522-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-07T18:03:38.374 INFO:teuthology.orchestra.run.smithi172.stderr:tar: Error is not recoverable: exiting now 2023-12-07T18:03:38.375 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-07T18:03:38.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-12-07T18:03:38.438 INFO:teuthology.orchestra.run.smithi172.stderr:grep: /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-07T18:03:38.440 INFO:tasks.cephadm:Compressing logs... 2023-12-07T18:03:38.440 DEBUG:teuthology.orchestra.run.smithi172:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-07T18:03:38.499 INFO:teuthology.orchestra.run.smithi172.stderr:find: '/var/log/rbd-target-api': No such file or directory 2023-12-07T18:03:38.506 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-07T18:03:38.507 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mon.smithi172.log 2023-12-07T18:03:38.507 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vkjzkx.log 2023-12-07T18:03:38.508 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mon.smithi172.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.1.log 2023-12-07T18:03:38.508 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.occzht.log 2023-12-07T18:03:38.509 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vkjzkx.log: /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vknhna.log 2023-12-07T18:03:38.509 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.occzht.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vcqlox.log 2023-12-07T18:03:38.510 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vknhna.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.nqsqxd.log 2023-12-07T18:03:38.510 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.0.log 2023-12-07T18:03:38.520 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vcqlox.log: /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.nqsqxd.log: 90.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vknhna.log.gz 2023-12-07T18:03:38.521 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.3.log 2023-12-07T18:03:38.521 INFO:teuthology.orchestra.run.smithi172.stderr: 90.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vkjzkx.log.gz 2023-12-07T18:03:38.521 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-volume.log 2023-12-07T18:03:38.522 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.3.log: 90.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.vcqlox.log.gz 2023-12-07T18:03:38.522 INFO:teuthology.orchestra.run.smithi172.stderr: 93.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-07T18:03:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.ceph-exporter.smithi172.log 2023-12-07T18:03:38.523 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.2.log 2023-12-07T18:03:38.526 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.ceph-exporter.smithi172.log: 94.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.occzht.log.gz 2023-12-07T18:03:38.526 INFO:teuthology.orchestra.run.smithi172.stderr:gzip -5 --verbose -- /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.uqvxqq.log 2023-12-07T18:03:38.528 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.2.log: 94.8% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.ceph-exporter.smithi172.log.gz 2023-12-07T18:03:38.536 INFO:teuthology.orchestra.run.smithi172.stderr:/var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.uqvxqq.log: 91.3% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-volume.log.gz 2023-12-07T18:03:38.536 INFO:teuthology.orchestra.run.smithi172.stderr: 90.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-client.rgw.foo.smithi172.uqvxqq.log.gz 2023-12-07T18:03:38.946 INFO:teuthology.orchestra.run.smithi172.stderr: 90.1% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mgr.smithi172.nqsqxd.log.gz 2023-12-07T18:03:39.085 INFO:teuthology.orchestra.run.smithi172.stderr: 93.1% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.0.log.gz 2023-12-07T18:03:39.089 INFO:teuthology.orchestra.run.smithi172.stderr: 93.2% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.3.log.gz 2023-12-07T18:03:39.127 INFO:teuthology.orchestra.run.smithi172.stderr: 92.6% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.2.log.gz 2023-12-07T18:03:39.189 INFO:teuthology.orchestra.run.smithi172.stderr: 92.9% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-osd.1.log.gz 2023-12-07T18:03:39.619 INFO:teuthology.orchestra.run.smithi172.stderr: 90.0% -- replaced with /var/log/ceph/4fe67048-9522-11ee-95a2-87774f69a715/ceph-mon.smithi172.log.gz 2023-12-07T18:03:39.621 INFO:teuthology.orchestra.run.smithi172.stderr: 2023-12-07T18:03:39.621 INFO:teuthology.orchestra.run.smithi172.stderr:real 0m1.133s 2023-12-07T18:03:39.621 INFO:teuthology.orchestra.run.smithi172.stderr:user 0m3.898s 2023-12-07T18:03:39.621 INFO:teuthology.orchestra.run.smithi172.stderr:sys 0m0.186s 2023-12-07T18:03:39.622 INFO:tasks.cephadm:Archiving logs... 2023-12-07T18:03:39.622 DEBUG:teuthology.misc:Transferring archived files from smithi172:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167/remote/smithi172/log 2023-12-07T18:03:39.623 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-07T18:03:40.251 INFO:tasks.cephadm:Removing cluster... 2023-12-07T18:03:40.251 DEBUG:teuthology.orchestra.run.smithi172:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 4fe67048-9522-11ee-95a2-87774f69a715 --force 2023-12-07T18:03:40.435 INFO:teuthology.orchestra.run.smithi172.stdout:Deleting cluster with fsid: 4fe67048-9522-11ee-95a2-87774f69a715 2023-12-07T18:03:41.638 INFO:tasks.cephadm:Removing cephadm ... 2023-12-07T18:03:41.638 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-07T18:03:41.644 INFO:tasks.cephadm:Teardown complete 2023-12-07T18:03:41.644 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-07T18:03:41.655 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-07T18:03:41.655 DEBUG:teuthology.orchestra.run.smithi172:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-07T18:03:41.709 INFO:teuthology.orchestra.run.smithi172.stdout: remote refid st t when poll reach delay offset jitter 2023-12-07T18:03:41.709 INFO:teuthology.orchestra.run.smithi172.stdout:============================================================================== 2023-12-07T18:03:41.710 INFO:teuthology.orchestra.run.smithi172.stdout:*hv01.front.sepi 44.4.53.2 2 u 58 128 377 0.122 -0.237 0.208 2023-12-07T18:03:41.710 INFO:teuthology.orchestra.run.smithi172.stdout:+hv02.front.sepi 63.231.80.2 3 u 35 128 377 0.181 -1.262 0.127 2023-12-07T18:03:41.710 INFO:teuthology.orchestra.run.smithi172.stdout:+hv03.front.sepi 74.6.168.72 3 u 36 128 377 0.091 0.688 0.035 2023-12-07T18:03:41.710 INFO:teuthology.orchestra.run.smithi172.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-12-07T18:03:41.711 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-07T18:03:41.719 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-07T18:03:41.720 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-07T18:03:41.729 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-07T18:03:41.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-07T18:03:41.746 INFO:teuthology.task.internal:Duration was 4386.578993 seconds 2023-12-07T18:03:41.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-07T18:03:41.755 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-07T18:03:41.755 DEBUG:teuthology.orchestra.run.smithi172:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-07T18:03:41.802 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-07T18:03:41.803 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi172.front.sepia.ceph.com 2023-12-07T18:03:41.803 DEBUG:teuthology.orchestra.run.smithi172:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-07T18:03:41.817 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-07T18:03:41.817 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-07T18:03:41.941 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-07T18:03:41.941 DEBUG:teuthology.orchestra.run.smithi172:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-07T18:03:42.142 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-07T18:03:42.152 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-07T18:03:42.152 DEBUG:teuthology.orchestra.run.smithi172:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-07T18:03:42.168 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-07T18:03:42.177 DEBUG:teuthology.orchestra.run.smithi172:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-07T18:03:42.225 INFO:teuthology.orchestra.run.smithi172.stdout:kernel.core_pattern = core 2023-12-07T18:03:42.251 DEBUG:teuthology.orchestra.run.smithi172:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-07T18:03:42.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-07T18:03:42.301 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-07T18:03:42.310 INFO:teuthology.task.internal:Transferring archived files... 2023-12-07T18:03:42.311 DEBUG:teuthology.misc:Transferring archived files from smithi172:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167/remote/smithi172 2023-12-07T18:03:42.311 DEBUG:teuthology.orchestra.run.smithi172:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-07T18:03:42.379 INFO:teuthology.task.internal:Removing archive directory... 2023-12-07T18:03:42.379 DEBUG:teuthology.orchestra.run.smithi172:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-07T18:03:42.418 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-07T18:03:42.428 INFO:teuthology.task.internal:Not uploading archives. 2023-12-07T18:03:42.428 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-07T18:03:42.437 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-07T18:03:42.437 DEBUG:teuthology.orchestra.run.smithi172:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-07T18:03:42.466 INFO:teuthology.orchestra.run.smithi172.stdout: 1048624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 7 18:03 /home/ubuntu/cephtest 2023-12-07T18:03:42.469 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-07T18:03:42.478 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-07T18:03:42.496 INFO:teuthology.nuke:Checking targets against current locks 2023-12-07T18:03:42.525 DEBUG:teuthology.nuke:shortname: smithi172 2023-12-07T18:03:42.526 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-07T18:03:42.549 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-07_16:37:24-rados-wip-yuri8-testing-2023-12-06-1425-distro-default-smithi/7482167', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-07 16:39:22.422126', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-07T18:03:42.595 INFO:teuthology.orchestra.console.smithi172:Power off 2023-12-07T18:03:42.595 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-07T18:03:42.618 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-12-07T18:03:42.618 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T18:03:42.639 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T18:03:46.641 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T18:03:46.753 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-12-07T18:03:50.756 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-07T18:03:50.864 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-12-07T18:03:50.965 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-12-07T18:03:51.069 INFO:teuthology.run:Summary data: description: rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} duration: 4386.578992605209 failure_reason: reached maximum tries (301) after waiting for 300 seconds owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=99106944716249bcb64427549366372e status: fail success: false 2023-12-07T18:03:51.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-07T18:03:51.144 INFO:teuthology.run:FAIL