Monitoring
Deploying a workflow will automatically enable Monitoring and Logging for that workflow. You will be able to find your workflow under monitoring and logging.
Out of the box, you can monitor on:
Model Performance Metrics: Track the accuracy, response time, and efficiency of the language models in real-time.
Usage Metrics: Keep tabs on the frequency of use, the types of tasks performed, and the volume of requests handled by the platform.
User Feedback and Error Rates: Monitoring feedback and error rates is crucial for improving the platform. Automatically track errors in output, such as inaccuracies or irrelevant responses, and collect user feedback directly through the platform for ongoing improvements.
System Health and Uptime: Regularly check the health of the underlying infrastructure, including server load, API response times, and system uptime. This ensures that the platform remains reliable and available for users when needed.
Resource Consumption: Monitor the consumption of computational resources, such as CPU and memory usage, especially during peak load times. This can help in optimizing resource allocation and predicting future needs as user base and usage grow
Last updated