Introducing Amazon CloudWatch Evidently for feature experimentation and safer launches
Amazon CloudWatch Evidently is a new capability which helps application developers safely validate new features across the full application stack. Developers can use Evidently to conduct experiments on new application features and identify unintended consequences, thereby reducing risk. When launching new features, developers can expose the features to a subset of users, monitor key metrics such as page load times and conversions, then safely dial up traffic for general use. Amazon CloudWatch Evidently is part of CloudWatch’s Digital Experience Monitoring capabilities along with Amazon CloudWatch Synthetics and Amazon CloudWatch RUM.
Amazon CloudWatch Evidently is a new capability which helps application developers safely validate new features across the full application stack. Developers can use Evidently to conduct experiments on new application features and identify unintended consequences, thereby reducing risk. When launching new features, developers can expose the features to a subset of users, monitor key metrics such as page load times and conversions, then safely dial up traffic for general use. Amazon CloudWatch Evidently is part of CloudWatch’s Digital Experience Monitoring capabilities along with Amazon CloudWatch Synthetics and Amazon CloudWatch RUM.
Evidently helps you remove guesswork when deciding which features are the best ones for your business, whether a new user experience, machine learning recommendations model, or server side implementation. Experimental results are presented in a clear way so you don't need advanced statistical knowledge to interpret them. While an experiment is running, anytime p-value and confidence intervals allow you to see when there is statistical significance so you can end the experiment. To launch with confidence, Evidently has a granular scheduling capability to dial up traffic in a controlled manner, while monitoring key business and performance metrics for the new feature. You can define alarms to roll back to a safe state if there are issues with the launch. Evidently also integrates with CloudWatch RUM, a new feature for client side application performance monitoring, so RUM metrics can be used directly in Evidently.
Starting today, Evidently is generally available in 9 AWS regions: US East (N. Virginia), US East (Ohio), US West (Oregon), Europe (Ireland), Europe (Frankfurt), Europe (Stockholm), Asia Pacific (Sydney), Asia Pacific (Tokyo), and Asia Pacific (Singapore).
To get started, see the following list of resources:
- Blog post on getting started with Evidently
- User guide on Evidently
- For pricing, please refer to the Amazon CloudWatch pricing page