Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RDV: Fix the performance issue on AT sites #41248

Merged
merged 7 commits into from
Jan 24, 2025

Conversation

BogdanUngureanu
Copy link
Contributor

Fixes Automattic/wp-calypso#98603

When the ExPlat API returns a null assignment value we don't cache the result, thus making an API request on every page load.

Since only a12s should be un-assigned to a variation, this PR adds "treatment" variation as a fallback value.

Proposed changes:

  • Default to treatment for users that don't have an assignment returned

Other information:

  • Have you written new tests for your changes, if applicable?
  • Have you checked the E2E test CI results, and verified that your changes do not break them?
  • Have you tested your changes on WordPress.com, if applicable (if so, you'll see a generated comment below with a script to run)?

Jetpack product discussion

Does this pull request change what data or activity we track or use?

Testing instructions:

  • Install the change on your Atomic site
  • Make sure you get treatment
  • Make sure that we don't make an API request on each page load (using the debug tool)

@BogdanUngureanu BogdanUngureanu self-assigned this Jan 22, 2025
Copy link
Contributor

github-actions bot commented Jan 22, 2025

Are you an Automattician? Please test your changes on all WordPress.com environments to help mitigate accidental explosions.

  • To test on WoA, go to the Plugins menu on a WordPress.com Simple site. Click on the "Upload" button and follow the upgrade flow to be able to upload, install, and activate the Jetpack Beta plugin. Once the plugin is active, go to Jetpack > Jetpack Beta, select your plugin, and enable the fix/experiment-performance-issue branch.

    • For jetpack-mu-wpcom changes, also add define( 'JETPACK_MU_WPCOM_LOAD_VIA_BETA_PLUGIN', true ); to your wp-config.php file.
  • To test on Simple, run the following command on your sandbox:

    bin/jetpack-downloader test jetpack-mu-wpcom-plugin fix/experiment-performance-issue
    

Interested in more tips and information?

  • In your local development environment, use the jetpack rsync command to sync your changes to a WoA dev blog.
  • Read more about our development workflow here: PCYsg-eg0-p2
  • Figure out when your changes will be shipped to customers here: PCYsg-eg5-p2

Copy link
Contributor

github-actions bot commented Jan 22, 2025

Thank you for your PR!

When contributing to Jetpack, we have a few suggestions that can help us test and review your patch:

  • ✅ Include a description of your PR changes.
  • ✅ Add a "[Status]" label (In Progress, Needs Team Review, ...).
  • ✅ Add a "[Type]" label (Bug, Enhancement, Janitorial, Task).
  • ✅ Add testing instructions.
  • ✅ Specify whether this PR includes any changes to data or privacy.
  • ✅ Add changelog entries to affected projects

This comment will be updated as you work on your PR and make changes. If you think that some of those checks are not needed for your PR, please explain why you think so. Thanks for cooperation 🤖


The e2e test report can be found here. Please note that it can take a few minutes after the e2e tests checks are complete for the report to be available.


Follow this PR Review Process:

  1. Ensure all required checks appearing at the bottom of this PR are passing.
  2. Choose a review path based on your changes:
    • A. Team Review: add the "[Status] Needs Team Review" label
      • For most changes, including minor cross-team impacts.
      • Example: Updating a team-specific component or a small change to a shared library.
    • B. Crew Review: add the "[Status] Needs Review" label
      • For significant changes to core functionality.
      • Example: Major updates to a shared library or complex features.
    • C. Both: Start with Team, then request Crew
      • For complex changes or when you need extra confidence.
      • Example: Refactor affecting multiple systems.
  3. Get at least one approval before merging.

Still unsure? Reach out in #jetpack-developers for guidance!

@github-actions github-actions bot added the [Status] Needs Author Reply We would need you to make some changes or provide some more details about your PR. Thank you! label Jan 22, 2025
@@ -448,6 +448,17 @@ function wpcom_is_duplicate_views_experiment_enabled() {

if ( isset( $data['variations'] ) && isset( $data['variations'][ $experiment_name ] ) ) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When the experiment_name's value is NULL we don't go inside this branch.

@@ -451,11 +451,19 @@ function wpcom_is_duplicate_views_experiment_enabled() {
update_user_option( get_current_user_id(), $option_name, $variation, true );

$is_enabled = 'treatment' === $variation;
return $is_enabled;
} elseif ( isset( $data['variations'] ) && ! isset( $data['variations'][ $experiment_name ] ) ) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can improve/simplify the checks by:

if ( isset( $data['variations'][ $experiment_name ] ) ) {
    $variation = $data['variations'][ $experiment_name ];
    update_user_option( get_current_user_id(), $option_name, $variation, true );
    $is_enabled = 'treatment' === $variation;
} elseif ( isset( $data['variations'] ) ) {
  /**
   * If the variations array is set but the variation value is null chances are this is an a11n (since ExPlat returns null for a12s).
   * 
   * We want to set the treatment for all a12s.
   */
    update_user_option( get_current_user_id(), $option_name, 'treatment', true );
    $is_enabled = true;
} else {
    $is_enabled = false;
}

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, that could work too.

rcrdortiz
rcrdortiz previously approved these changes Jan 22, 2025
Copy link
Contributor

@rcrdortiz rcrdortiz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Besides the nit I left, everything works as expected now.

@BogdanUngureanu BogdanUngureanu added [Status] Needs Team Review [Type] Bug When a feature is broken and / or not performing as intended and removed [Status] Needs Author Reply We would need you to make some changes or provide some more details about your PR. Thank you! labels Jan 23, 2025
rcrdortiz
rcrdortiz previously approved these changes Jan 24, 2025
@rcrdortiz rcrdortiz merged commit cbd6957 into trunk Jan 24, 2025
60 checks passed
@rcrdortiz rcrdortiz deleted the fix/experiment-performance-issue branch January 24, 2025 14:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
[mu wpcom Feature] Wpcom Admin Interface [Package] Jetpack mu wpcom WordPress.com Features [Type] Bug When a feature is broken and / or not performing as intended
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Jetpack: Test assignments slowing page generation time for Atomic sites
2 participants