[BUG] Column names unescaped during index creation.

[Swiddis]

What is the bug?
When trying to work with tables that have escaped column names, this escaping is thrown away during index creation.

How can one reproduce the bug?
Steps to reproduce the behavior:

1. Create a table with column names that require escaping:

CREATE TABLE
  mys3.default.sample_table_dot_cols (`fields.name` string, `fields.count` int) USING PARQUET LOCATION 's3://sample-location/sample-dotcol';

2. Then attempt to create an index on that table:

CREATE INDEX sample_index ON mys3.default.sample_table_dot_cols (`fields.name`, `fields.count`)
WITH
  (auto_refresh = true);

3. Wait for query to fail and check logs, you'll see the error:

23/10/19 22:30:42 ERROR FlintJob: Fail to verify existing mapping or write result
org.apache.spark.sql.catalyst.parser.ParseException: 
Syntax error at or near '.': extra input '.'(line 1, pos 6)

== SQL ==
fields.name string not null,fields.count int not null
------^^^

Which indicates that at some point in internal processing (maybe in FlintSparkIndex.scala), the column names are being unescaped.

What is the expected behavior?
If the column name is escaped in the index creation query, it should be correctly handled. Alternatively, if escaping column names isn't supported, there should be an error on table creation.

What is your host/environment?

• OS: Ubuntu
• Version: 22.04
• Plugins: plugin:observabilityDashboards@2.11.0, plugin:queryWorkbenchDashboards@2.11.0

Do you have any screenshots?
N/A

Do you have any additional context?
N/A

[dai-chen]

May miss this logic. Will verify and fix it shortly. Thanks!

[dai-chen]

Working on PR to handle quoted table/MV/column name.

[dai-chen]

@Swiddis I can confirm Flint extension does unquote identifier automatically. Your error was actually thrown from Spark Application code. Wonder if you still have the error stack or more info. For now I didn't figure out which code is the root cause. cc: @kaituo

[dai-chen]

The issue should be fixed in PR above. Please verify. Thanks!