Developers can now gain visibility into ChatGPT usage, latency and token consumption in order to optimize the performance, end user experience and cost of their AI applications
NEW YORK, May 10, 2023 /PRNewswire/ — Datadog, Inc. (NASDAQ: DDOG), the monitoring and security platform for cloud applications, today announced a new integration that monitors OpenAI API usage patterns, costs and performance for various OpenAI models, including GPT-4 and other completion models. Datadog’s observability capabilities simplify the process of data collection through tracing libraries so that customers can easily and quickly start monitoring their OpenAI usage.
As adoption of OpenAI’s newest generative AI model scales and more teams within organizations experiment with ChatGPT, the ability to understand user interactions with GPT-powered applications is vital for identifying opportunities to fine-tune models and enhance user experiences. Monitoring usage of the API and token consumption is also essential in controlling spend and improving application performance. By providing actionable insights into the API’s usage, latency and costs, organizations will be able to use AI models more effectively so that they can focus on what matters most—improving day-to-day operations and innovating on products and services.
Datadog’s integration with OpenAI enables organizations to:
- Understand Usage: With an easy setup process, users can quickly realize comprehensive insights into overall OpenAI usage of APIs, token consumption and costs split by service, teams and API keys with Datadog’s out-of-the-box dashboards. Preconfigured out-of-the-box alerts also help users stay on top of OpenAI API rate limits.
- Optimize Performance: By tracking API error rates, rate limits and response times, Datadog allows users to identify and isolate application performance issues from API performance issues. Furthermore, users can view their traces and logs containing prompt and completion examples to understand key application bottlenecks and user behaviors.
- Track Costs: Users can review token allocation and analyze the associated costs of OpenAI API calls. Datadog offers insights into token allocation by model, service and organization to help teams manage their expenses more effectively and avoid unexpected bills.
- Cover Multiple AI Models: In addition to covering the GPT family of large language models, Datadog’s integration enables organizations to track performance, costs and usage for other OpenAI models, including Ada, Babbage, Curie and Davinci.
“ChatGPT has become a powerful tool for software development, content creation and more. As users continue to experiment with AI models, teams across an organization—from engineering and marketing to legal and finance—need the ability to understand how the models are performing and how much time, money and resources users are dedicating to OpenAI models,” said Yrieix Garnier, VP of Product at Datadog. “Datadog’s integration with ChatGPT provides out-of-the-box dashboards users can leverage to monitor for rate limits and track internal usage patterns, costs and API performance, so that they can get a clear picture of ChatGPT allocation and consumption throughout the organization.”
To get started with Datadog’s integration for OpenAI, please visit: https://www.datadoghq.com/solutions/openai. To learn more, visit: https://www.datadoghq.com/blog/monitor-openai-with-datadog.
About Datadog
Datadog is the observability and security platform for cloud applications. Our SaaS platform integrates and automates infrastructure monitoring, application performance monitoring, log management, real-user monitoring, and many other capabilities to provide unified, real-time observability and security for our customers’ entire technology stack. Datadog is used by organizations of all sizes and across a wide range of industries to enable digital transformation and cloud migration, drive collaboration among development, operations, security and business teams, accelerate time to market for applications, reduce time to problem resolution, secure applications and infrastructure, understand user behavior, and track key business metrics.
Forward-Looking Statements
This press release may include certain “forward-looking statements” within the meaning of Section 27A of the Securities Act of 1933, as amended, or the Securities Act, and Section 21E of the Securities Exchange Act of 1934, as amended including statements on the benefits of new products and features. These forward-looking statements reflect our current views about our plans, intentions, expectations, strategies and prospects, which are based on the information currently available to us and on assumptions we have made. Actual results may differ materially from those described in the forward-looking statements and are subject to a variety of assumptions, uncertainties, risks and factors that are beyond our control, including those risks detailed under the caption “Risk Factors” and elsewhere in our Securities and Exchange Commission filings and reports, including the Quarterly Report on Form 10-Q filed with the Securities and Exchange Commission on May 5, 2023, as well as future filings and reports by us. Except as required by law, we undertake no duty or obligation to update any forward-looking statements contained in this release as a result of new information, future events, changes in expectations or otherwise.
Contact
Dan Haggerty
[email protected]
SOURCE Datadog, Inc.
