Add test for constraint framework

[feilong-liu]

Description

Add test mentioned in #22171 so as to avoid reintroducing the same problem.

Motivation and Context

To avoid reintroduce the same problem

Impact

Avoid potential bug

Test Plan

Change is only in test

Contributor checklist

• Please make sure your submission complies with our development, formatting, commit message, and attribution guidelines.
• PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
• Documented new properties (with its default value), SQL syntax, functions, or other functionality.
• If release notes are required, they follow the release notes guidelines.
• Adequate tests were added if applicable.
• CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== NO RELEASE NOTE ==

[tdcmeehan]

Thanks for adding this test