Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(optimizer): Join Factorization Rule, Optimizer Independent and Confuse #352

Merged
merged 27 commits into from
Jun 14, 2024

Conversation

Yihao-Xu
Copy link
Contributor

@Yihao-Xu Yihao-Xu commented Jun 6, 2024

实现了Join Factorization规则:

  • 如果UNION ALL两端的算子树具有相同的分支(即扫描的path和谓词都一致),可以将其提取出来到UNION ALL之后处理,将2次数据扫描和处理减少为1次。但一些情况下数据顺序可能会发生变化。

实现了Optimizer模块的独立和混淆功能:

  • 为了单独将Optimizer打成Jar包,将Optimizer独立出来成为子模块,并通过调整,使得Optimizer单向依赖core模块而core模块不依赖Optimizer模块,core模块依赖Optimizer模块的地方,将interface留在core模块,再通过ClassLoader来调用。
  • 实现了Optimizer的jar包代码混淆,使用了proguard插件,执行mvn clean install时就能自动生成jar包并混淆,并复制一份到core/target内。IGinX的构建流程和以往一样。
  • 修改了CI流程,可以用上传的optimizer jar包来进行测试。optimizer jar包放置在optimizer resource文件夹中,本PR更改CI流程,将上传jar包替换构建出的jar包,因此可以使用jar包中的规则来测试。

@Yihao-Xu Yihao-Xu closed this Jun 6, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 6, 2024
@Yihao-Xu Yihao-Xu force-pushed the feat-Factorization branch from 8b95be9 to 9945bc6 Compare June 6, 2024 01:43
@Yihao-Xu Yihao-Xu closed this Jun 6, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 6, 2024
@Yihao-Xu Yihao-Xu force-pushed the feat-Factorization branch from 9945bc6 to 4b2edfb Compare June 6, 2024 01:58
@Yihao-Xu Yihao-Xu closed this Jun 6, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 6, 2024
@Yihao-Xu Yihao-Xu force-pushed the feat-Factorization branch from 4b2edfb to 2146639 Compare June 6, 2024 02:28
@Yihao-Xu Yihao-Xu closed this Jun 6, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 6, 2024
@Yihao-Xu Yihao-Xu force-pushed the feat-Factorization branch from 2146639 to a03e3c0 Compare June 6, 2024 03:09
@Yihao-Xu Yihao-Xu closed this Jun 6, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 6, 2024
@Yihao-Xu Yihao-Xu closed this Jun 11, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 11, 2024
@Yihao-Xu Yihao-Xu closed this Jun 11, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 11, 2024
@Yihao-Xu Yihao-Xu closed this Jun 12, 2024
@Yihao-Xu Yihao-Xu reopened this Jun 12, 2024
@zhuyuqing zhuyuqing merged commit 7326021 into IGinX-THU:main Jun 14, 2024
96 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants