feat(SemanticLayerSchema): Refactoring using SemanticLayerSchema all over the code instead of the dictionary

[scaliseraoul]

• Tests added and passed if fixing a bug or adding a new feature.
• All code checks passed.

---

Important

Refactor code to use SemanticLayerSchema instead of dictionaries for schema representation, enhancing type safety and readability, with updated tests.

• Refactoring:
  • Replace dictionary-based schema with SemanticLayerSchema in loader.py, query_builder.py, and base.py.
  • Update DatasetLoader to use SemanticLayerSchema for schema handling.
  • Modify QueryBuilder to accept SemanticLayerSchema.
• Schema Validation:
  • Add validation for source type and fields in Source class in semantic_layer_schema.py.
  • Ensure Destination format is supported in semantic_layer_schema.py.
• Tests:
  • Update tests in test_loader.py, test_query_builder.py, and test_semantic_layer_schema.py to use SemanticLayerSchema.
  • Add tests for schema validation and transformation handling.
• Miscellaneous:
  • Remove _validate_schema method from DataFrame class in base.py.
  • Add to_yaml method in SemanticLayerSchema for YAML serialization.

^{This description was created by for a43c1db. It will automatically update as commits are pushed.}

[ellipsis-dev]

❌ Changes requested. Reviewed everything up to a43c1db in 2 minutes and 10 seconds

More details

• Looked at 944 lines of code in 9 files
• Skipped 0 files when reviewing.
• Skipped posting 4 drafted comments based on config settings.

1. pandasai/data_loader/loader.py:231

• Draft comment:
  Consider adding a check for unsupported cache formats and raise an exception to handle them explicitly.
• Reason this comment was not posted:
  Marked as duplicate.

2. pandasai/dataframe/virtual_dataframe.py:36

• Draft comment:
  Ensure schema.source.table and schema.description are not None before using them to initialize table_name and description.
• Reason this comment was not posted:
  Comment did not seem useful.

3. pandasai/data_loader/loader.py:156

• Draft comment:
  The error message for unsupported file format should be more informative. Consider using:

            raise ValueError(f"Unsupported file format: {format}. Supported formats are: 'csv', 'parquet'.")

• Reason this comment was not posted:
  Comment was on unchanged code.

4. pandasai/data_loader/loader.py:231

• Draft comment:
  The error message for unsupported cache format should be more informative. Consider using:

raise ValueError(f"Unsupported cache format: {cache_format}. Supported formats are: 'csv', 'parquet'.")

• Reason this comment was not posted:
  Marked as duplicate.

Workflow ID: wflow_UnFzo6WKG0Sqz2QQ

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.