Fix issue where query get interrupted during prepare.

[khanaffan]

imodel-native: iTwin/imodel-native#973

Fixes: #7549

• Do not interrupt the query during preparation. The query can only be interrupted during the step() function.
• Add an option to prepare ECSQL using a thread database connection. Experimental.
  • Default to false. Not enabled.
  • Thread does not wait to acquire lock on primary connection to prepare statement. Enhance faster.
  • Side effect more memory as each connection load its on EC Schema when preparing ECSQL.
• Query statistics now also return preparation time in nanoseconds.
• Introduce a feature to automatically shut down concurrent queries when idle for a set time:
  • Defaults to 30 minutes.
  • Closes all threads and releases resources used by concurrent queries.
  • Automatically wakes up when a new request comes in.
  • New error code is added ShuttingDown which cause frontend to retry.
• Allow setting the memory map I/O size for each connection, defaulting to 0 (not used):
  • This is an experimental option. It improves query performance on regular files but is untested with cloud SQLite.
• The statement cache size per thread can now be configured, with the default remaining at 40 (unchanged from previous).
• Fix a issue where delay use for testing cause every query to delay at least once even when not testing.
• Added allowTestingArgs help simulate a condition for testing.
• Found another issue which cause thread dead lock during closing connection. ConcurrentQuery config is not stored on db connection anymore.
  The default config look as following. Only new change is autoShutdowWhenIdealForSeconds: 1800

{
  workerThreads: 4,
  requestQueueSize: 2000,
  ignorePriority: false,
  ignoreDelay: true,
  doNotUsePrimaryConnToPrepare: false,
  autoShutdowWhenIdlelForSeconds: 1800,
  statementCacheSizePerWorker: 40,
  monitorPollInterval: 1000,
  memoryMapFileSize: 0,
  allowTestingArgs: false,
  globalQuota: { time: 60, memory: 8388608 }
}

[aruniverse]

approving addon bump

[mergify]

This pull request is now in conflicts. Could you fix it @khanaffan? 🙏
To fixup this pull request, you can check out it locally. See documentation: https://help.github.com/articles/checking-out-pull-requests-locally/

[khanaffan]

@Mergifyio backport release/4.10.x release/4.11.x

[mergify]

backport release/4.10.x release/4.11.x

✅ Backports have been created

• #7654 Fix issue where query get interrupted during prepare. (backport #7592) [release/4.10.x] has been created for branch release/4.10.x but encountered conflicts
• #7655 Fix issue where query get interrupted during prepare. (backport #7592) [release/4.11.x] has been created for branch release/4.11.x but encountered conflicts