Feature Request: Support for Custom Metrics in Quickwit

[yarntalecutters]

Summary

I would like to propose a feature that enables Quickwit to support custom metrics for better observability. This would enhance Quickwit's capabilities in handling various data types, specifically user-defined metrics that can be crucial for certain applications.

Motivation

Currently, Quickwit excels at logging and tracing but lacks support for custom metrics. Incorporating this feature would not only broaden its use cases but also attract users who rely heavily on metrics for observability.

Proposed Solution

• Custom Metrics API: Introduce an API endpoint that allows users to send custom metrics data to Quickwit.
• Data Structuring: Define a clear structure for custom metrics that includes attributes such as:
  • Metric name (string)
  • Metric value (float or integer)
  • Timestamp (datetime)
  • Tags (key-value pairs for additional context)
• Dashboard Integration: Create a section in the Quickwit dashboard to visualize these custom metrics alongside existing data.

Steps to Reproduce

1. User sends a POST request to the new custom metrics API with the defined structure.
2. Metrics data is stored and indexed by Quickwit.
3. User accesses the Quickwit dashboard to visualize the data.

Expected Outcome

Users should be able to send and view custom metrics in Quickwit seamlessly, similar to how they currently manage logs and traces.

Actual Outcome

Currently, there is no support for custom metrics in Quickwit, limiting its flexibility and use cases.

Additional Context

This feature would also be beneficial for integration with monitoring tools and dashboards, thus enhancing overall observability capabilities.

Thank you for considering this feature request!