diff --git a/CHANGELOG.md b/CHANGELOG.md
index f74fb7e38a671..88f4d2892d874 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -18,7 +18,8 @@ in conjunction with wildcard dimension values as it will control the amount of
 time before a new metric is included by the plugin.
 
 - The github webhooks have been integrated into the new webhooks plugin. You
-have to configure the new `webhooks` plugins.
+have to configure the new `webhooks` plugins and update your Organization's
+Webhooks on the Github website accordingly.
 
 ### Features