Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

don't save index events for indexers in manual mode #199

Closed
wants to merge 3 commits into from

Conversation

bob2021
Copy link
Contributor

@bob2021 bob2021 commented Mar 2, 2017

This is part of a group of PRs containing the changes discussed in issue #152

If an indexer is in manual mode, there is no need to save an index event as it will never be processed - manual mode indexes can only be updated using a full reindex.

Index event data can grow very large (megabytes) for mass_action events. It is not cleaned properly after processing and new data is often appended without deduplication.

This PR prevents index events from registering with an indexer if it is in manual mode. It also ensures that index data is cleaned during a partial 'full' reindex.

@bob2021 bob2021 force-pushed the mass_event-cleaning branch 2 times, most recently from b5436aa to af95a16 Compare March 6, 2017 10:27
@bob2021 bob2021 changed the base branch from 1.9.2.4 to 1.9.3.x March 6, 2017 10:27
@Flyingmana
Copy link
Contributor

some of the async index modules are actually making use of this, one example is https://github.com/magento-hackathon/AsyncIndex

and as it is something which is really used inside the EE version, Iam sure there are more modules out there, who use this to patch functionality into the CE

@tbaden tbaden added the review needed Problem should be verified label Jun 1, 2019
@sreichel sreichel added the Component: Index Relates to Mage_Index label Jun 6, 2020
@fballiano fballiano closed this Jun 2, 2022
@fballiano fballiano reopened this Jun 2, 2022
@fballiano fballiano changed the base branch from 1.9.3.x to 1.9.4.x June 2, 2022 11:20
@bob2021
Copy link
Contributor Author

bob2021 commented Jun 6, 2022

I am no longer involved with Magento development and I will not be contributing any further changes to this PR so I am closing it.

@bob2021 bob2021 closed this Jun 6, 2022
@addison74
Copy link
Contributor

I understand the situation but a simple statement that you are no longer involved in the project was enough without closing the PR, leaving it to the appreciation of others who are still active if your work so far can be useful OpenMage.

@addison74 addison74 reopened this Jun 6, 2022
@fballiano
Copy link
Contributor

some of the async index modules are actually making use of this, one example is https://github.com/magento-hackathon/AsyncIndex

and as it is something which is really used inside the EE version, Iam sure there are more modules out there, who use this to patch functionality into the CE

@Flyingmana would it be better, in your opinion, to live the code as it is for compatibility with other modules?

I kinda think that this PR is a good one to be implemented in our code.

@tobihille
Copy link
Contributor

As a compromise between this PR and @Flyingmana's statement I would suggest that a cron is created that deletes the old events if they are not consumed by e.g. AsyncIndex.
This way the DB will not overflow and BC is guaranteed (at least for the configured time).
Sadly I don't know how to contribute to a PR that is not mine, would it be beneficial if I create my own PR and reference this one?

@addison74
Copy link
Contributor

addison74 commented Aug 22, 2022

@tobihille - The author chose not to contribute to OM anymore and I thank him for letting us know. I left the PR open because it needs modifications. If you consider you can create a better one please feel free to open your own PR and we will close this one.

@fballiano
Copy link
Contributor

I'm taking responsibility and closing this, it is a very good idea IMHO but so is the asyncIndex and #2474 is the right middleway

@fballiano fballiano closed this Mar 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Index Relates to Mage_Index review needed Problem should be verified
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants