Alerts
Monitor your application with customizable alerts
Alerts
Puzzlet’s alert system allows you to monitor critical metrics for your applications and get notified when certain thresholds are exceeded. This helps you stay informed about your application’s performance and potential issues.

Overview
Alerts in Puzzlet help you:
- Monitor important metrics like cost, latency, and error rates
- Set thresholds for acceptable values
- Define time windows for measurement
- Receive notifications via Slack or webhooks when thresholds are exceeded
- Track alert history to analyze patterns
Available Metrics
Puzzlet currently supports alerts on the following metrics:
Metric | Description |
---|---|
Cost | Monitor the total cost of your API calls to LLM providers |
Latency | Track response times for your AI requests |
Error Rate | Monitor the percentage of failed requests |
Creating an Alert
To create a new alert:
- Navigate to your application’s dashboard
- Click on the “Alerts” tab in the navigation menu
- Click the “Create Alert” button
- Configure the alert with the following settings:
- Name: A descriptive name for the alert
- Metric: Select the metric to monitor (cost, latency, or error rate)
- Threshold: Set the threshold value that will trigger the alert
- Time Window: Define the period over which the metric is measured
Notification Options
Puzzlet offers multiple ways to receive alert notifications:
Slack Integration
To receive alerts via Slack:
- Enable the “Send to Slack” option when creating an alert
- If you haven’t connected Slack yet, click the “Connect Slack” button
- Select the Slack channel where notifications should be sent
Webhooks
For custom integrations, you can use webhooks:
- Enable the “Use Webhook” option when creating an alert
- Configure your webhook endpoint in the Developers section of your application
- Alerts will be sent as HTTP POST requests to your endpoint with alert details in the request body
For detailed information on implementing and configuring webhooks, including the exact payload format and handling instructions, see the Test Webhook documentation.
Alert Status
Alerts have two possible states:
- Triggered: When the monitored metric exceeds the defined threshold
- Resolved: When the metric returns below the threshold
Alert History
For each alert, you can view its history to analyze patterns and understand when and why alerts were triggered:
- Navigate to the “Alerts” tab in your application dashboard
- View the list of alerts
- Click on an alert to see its history, including:
- When the alert was triggered
- The actual value that triggered the alert
- When the alert was resolved
Best Practices
For effective alert management:
- Set meaningful thresholds based on your application’s normal behavior
- Use appropriate time windows to avoid alert fatigue from temporary spikes
- Configure integrations with your team’s communication tools
- Regularly review alert history to adjust thresholds as your usage patterns change
Next Steps
- Learn more about Traces and Logs
- Explore Sessions to understand user interactions
- Review Metrics for overall application performance
Was this page helpful?