Grafana Specialist for System Measures Visualization

**Title:** Create Grafana Dashboards for System Monitoring, Logging and Tracing metrics

**Description:**
I have several modules or microservices generating structured logs continuously, and I need an expert to create comprehensive Grafana dashboards for monitoring the health of this system, searching through logs effectively and visualizing them.

### **Scope of Work:**
- Parse and visualize log data with various types of charts and tables.
- Handle dynamic metadata fields within log entries in both visualization and searching.
- Design user-friendly dashboards with filters and automatic alerts.
- Set up dashboard or visualizer for Tracing Data of functions and services.
- Ensure integration with appropriate data sources (Loki, OpenTelemetry, Alloy, or others as needed).
- Optimize performance for large-scale log data.

### **Example Log Schema:**
```json
{
"message": "Got Quote Data for EQ/FNO",
"timestamp": 1739172158.9707787,
"function": "process_quote_packet",
"module": "bank",
"name": "data_bank_logger", // This is name of the logger, it's unique for each service or module
"level": "WARNING", // For simplicity, 4 log levels are used currently: ERROR, WARNING, INFO and DEBUG
"metadata": [
{
"scrip_id": {
"packet_type": 4,
"exchange": 1,
"scrip_id": 163,
"ltp": 426.5,
"ltt": 1739191956,
"volume": 1756151,
}
}
],
"file": "bank.py",
"path": "/home/harshal/p2-server/data_bank/bank.py",
"line": 311,
"stacktrace": "NoneType: None\n" // This format depends on Python in this case, it's necessity may vary
}
```

Since the **metadata field is dynamic**, the dashboard must accommodate various structures and data types so that any metadata can be visualized, viewed and searched effectively.

### **Requirements:**
- Experience with Grafana, Loki, A, or similar tools.
- Ability to work with dynamic and nested log structures.
- Strong knowledge of function tracing, log parsing and visualization techniques.
- Experience integrating Grafana with different databases.

### **Deliverables:**
- Fully functional Grafana dashboards.
- Configured data source connections.
- Custom visualization and alert rules.
- Documentation for dashboard maintenance.

If you have experience in building Grafana dashboards for complex logging systems, please apply with examples of previous work.