fix(code_manager): minor fixes in code manager #923

ArslanSaleem · 2024-02-03T21:45:17Z

No description provided.

coderabbitai · 2024-02-03T21:45:32Z

Important

Auto Review Skipped

Auto reviews are disabled on base/target branches other than the default branch. Please add the base/target branch pattern to the list of additional branches to be reviewed in the settings.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository.

To trigger a single review, invoke the @coderabbitai review command.

Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?

Share

Tips

Chat

There are 3 ways to chat with CodeRabbit:

Review comments: Directly reply to a review comment made by CodeRabbit. Example:
- I pushed a fix in commit <commit_id>.
- Generate unit-tests for this file.
Files and specific lines of code (under the "Files changed" tab): Tag @coderabbitai in a new review comment at the desired location with your query. Examples:
- @coderabbitai generate unit tests for this file.
- @coderabbitai modularize this function.
PR comments: Tag @coderabbitai in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples:
- @coderabbitai generate interesting stats about this repository from git and render them as a table.
- @coderabbitai show all the console.log statements in this repository.
- @coderabbitai read src/utils.ts and generate unit tests.
- @coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.

Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments.

CodeRabbit Commands (invoked as PR comments)

@coderabbitai pause to pause the reviews on a PR.
@coderabbitai resume to resume the paused reviews.
@coderabbitai review to trigger a review. This is useful when automatic reviews are disabled for the repository.
@coderabbitai resolve resolve all the CodeRabbit review comments.
@coderabbitai help to get help.

Additionally, you can add @coderabbitai ignore anywhere in the PR description to prevent this PR from being reviewed.

CodeRabbit Configration File (`.coderabbit.yaml`)

You can programmatically configure CodeRabbit by adding a .coderabbit.yaml file to the root of your repository.
The JSON schema for the configuration file is available here.
If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: # yaml-language-server: $schema=https://coderabbit.ai/integrations/coderabbit-overrides.v2.json

CodeRabbit Discord Community

Join our Discord Community to get help, request features, and share feedback.

sourcery-ai

PR Type: Enhancement

PR Summary: The pull request introduces several enhancements to the codebase, including refactoring the dictionary construction for clarity in the dataframe serializer, adding a new key to the extras dictionary in the base connector, and improving the code manager by handling additional AST node types and modifying the logic for required dataframes. The changes aim to improve code readability and maintainability.

Decision: Comment

📝 Type: 'Enhancement' - not supported yet.

Sourcery currently only approves 'Typo fix' PRs.

✅ Issue addressed: this change correctly addresses the issue or implements the desired feature.

No details provided.

✅ Small diff: the diff is small enough to approve with confidence.

No details provided.

General suggestions:

Ensure that the refactored dictionary construction in the dataframe serializer maintains all necessary keys and that the new structure is complete.
Verify that the addition of 'is_direct_sql' key to the extras dictionary is handled by all downstream consumers.
Carefully test the new AST node type handling in the code manager to prevent potential errors in AST manipulation.
Review the logic change in the code manager's '_required_dfs' method to confirm it aligns with the intended behavior, especially in cases where an empty list was previously returned.

Thanks for using Sourcery. We offer it for free for open source projects and would be very grateful if you could help us grow. If you like it, would you consider sharing Sourcery on your favourite social media? ✨

Share Sourcery

Help me be more useful! Please click 👍 or 👎 on each comment to tell me if it was helpful.

sourcery-ai · 2024-02-03T21:46:25Z

pandasai/helpers/dataframe_serializer.py


-        return result
+        return {df_number_key: df_info}


suggestion (llm): Refactoring the dictionary construction for clarity is a good improvement. However, ensure that the 'df_info' dictionary is complete and that all necessary keys are present as they were in the original 'result' dictionary.

sourcery-ai · 2024-02-03T21:46:25Z

pandasai/helpers/code_manager.py

@@ -98,7 +98,7 @@ def _required_dfs(self, code: str) -> List[str]:

        # Sometimes GPT-3.5/4 use a for loop to iterate over the dfs (even if there is only one)
        # or they concatenate the dfs. In this case we need all the dfs
-        if "for df in dfs" in code or "pd.concat(dfs)" in code:
+        if "for df in dfs" in code or "pd.concat(dfs" in code:


issue (llm): The change in the condition to check for 'pd.concat(dfs' seems to be missing the closing parenthesis. This could lead to incorrect behavior if the code checks for a partial string rather than the complete function call.

sourcery-ai · 2024-02-03T21:46:25Z

pandasai/helpers/code_manager.py

@@ -107,7 +107,7 @@ def _required_dfs(self, code: str) -> List[str]:
                required_dfs.append(df)
            else:
                required_dfs.append(None)
-        return required_dfs
+        return required_dfs or self._dfs


question (llm): The use of 'or' in the return statement is a clever way to ensure that '_dfs' is returned when 'required_dfs' is empty. However, it's important to confirm that this logic aligns with the intended behavior, as it changes the method's return value in cases where 'required_dfs' would previously return an empty list.

sourcery-ai · 2024-02-03T21:46:25Z

pandasai/helpers/code_manager.py

@@ -516,6 +517,9 @@ def _tokenize_operand(operand_node: ast.expr) -> Generator[str, None, None]:
            >>> print(list(res))
            ['foo', 2, 1, 0]
        """
+        if isinstance(operand_node, ast.Call):


suggestion (llm): Adding support for 'ast.Call' in the '_tokenize_operand' method is a good enhancement. Ensure that this addition is well-tested, especially since AST manipulation can be error-prone.

codecov-commenter · 2024-02-03T21:47:31Z

Codecov Report

All modified and coverable lines are covered by tests ✅

❗ No coverage uploaded for pull request base (release/v2.0@0dde843). Click here to learn what that means.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@               Coverage Diff               @@
##             release/v2.0     #923   +/-   ##
===============================================
  Coverage                ?   86.10%           
===============================================
  Files                   ?       91           
  Lines                   ?     3080           
  Branches                ?        0           
===============================================
  Hits                    ?     2652           
  Misses                  ?      428           
  Partials                ?        0

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

* refactor: clean code in smart_dataframe and smart_datalake (#814) * refactor: extract import from file method * refactor: extract df head methods * refactor: move connector config in the relative connector file * refactor: csv and pandas files are now treated as a connector * chore: remove verbose getters and setters * refactor: remove load and save feature * refactor: create dataframe proxy * chore: simplify agent * chore: simplify datalake * refactor: simplify smart datalake * refactor: centralize context in lakes * refactor: move lake callbacks to dedicate class * fix: load connector before generating cache hex * fix: only allow direct sql to SQLConnectors * fix: check sql connector was not working * fix(connector): update connector validation at the start * fix(direct_sql): fix some leftovers * fix: merged change revert built-in shadowing --------- Co-authored-by: ArslanSaleem <khan.arslan38@gmail.com> * refactor(query_tracker): clean code and create error handling pipeling (#875) * refactor(smart_datalake): clean chat method of smart datalake * refactor(smartlake_pipeline): minor cleanups and comments * refactor(query_tracker): refactor query tracker input and output * refactor(query_tracker): adding error pipeline * refactor(query_tracker): some rename and delete extras * refactor(query_tracker): remove comments * Merge Main Changes to v1.6 (#878) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * refactor: remove inheritance of pandas methods in the SmartDataframe * refactor: remove shortcuts * refactor: smart df cannot chat anymore * refactor: remove unused validate method from sdf * refactor: add name and description to connectors * refactor: remove custom prompts * refactor: remove synthetic pipelines * refactor: remove custom instructions * refactor: remove starcoder and falcon * refactor: move df head to connectors * refactor: remove sdf * refactor: remove leftovers logic units * refactor: rename SmartDataLake to AgentCore * refactor: rename DataLake pipeline to Chat * refactor: remove agent core, moving the logic to agent * refactor: refactor the prompt templates using Jinja2 * feat(Agent): train agent docs or question/answers (#895) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained data from vector db in prompt (#896) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained vector in prompt * Merge v1.6 into to v2.0 (#900) * refactor(Prompt): adding more context for dataframe and multiple types of serialization (#880) * refactor(prompt): update dataframe serialization in prompt * tests(prompt): fix and adding new tests * fix(prompt): adding type to dataframe serialize function * refactor(prompt): add field descriptions in yml prompt * fix(prompt): direct_sql still using old dataframe table * refactor(direct_sql): add instruction and note for using relevant table only * refactor(query_tracker): clean output of query tracker format (#888) * feat(GoogleBigQuery): adding google big query connector (#886) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained vector in prompt * Merge v1.6 to v2.0 * feat: execute_sql_query_usage creating error prompt if execute_sql_que… (#898) * feat/execute_sql_query_usage creating error prompt if execute_sql_query is not used when direct_sql is set to true * fix/comment added before raising exception --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-Air.digi.box> * fix(prompt_path): path issue if pandasai used outside of pandas env (#909) * feat(agent): adding optional pipeline call (#916) s * feat(system prompt): use system in llm prompts (#925) * fix(code_manager): minor fixes in code manager * feat(system_prompt): adding system prompts to be added in llm call * fix(code_manager): minor fixes in code manager (#923) Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * feat/update method in vector db added * feat/get by id method added * feat(multiturn-conv): update prompts and use api's for multiturn (#928) * fix(code_manager): minor fixes in code manager * feat(system_prompt): adding system prompts to be added in llm call * feat(multi-turn-conv): adding support for multi turn conversation * feat(multi-turn): add missing files * feat(BambooVectorStore): adding bamboo vector to store and retrieve t… (#935) * feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud * rename test class name * feat(BambooLLM): add bamboo llm wrapper (#940) * feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud * rename test class name * feat(bamboo_llm): adding bamboo llm interface * fix: clean up few commented and leftover changes * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * Merge to release 2.0 (#945) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default * fix(skills): add skills to query tracker and by default rag to return 1 message (#947) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * fix: function call check and query tracker tracking * fixes/in release2.0 (#951) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default * fix: function call check and query tracker tracking --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * update comparison operator (#953) * docs: improve readme and license * lint: fix lint in examples * docs: add deploy methods in the documentation * refactor: rename to ChromaDB * feat: make BambooVector the default vectorstore * lint: fix lint in examples * docs: add docs for training, agent description * docs: add video for training LLM --------- Co-authored-by: ArslanSaleem <khan.arslan38@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-Air.digi.box> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com>

* Release v2.0 * refactor: clean code in smart_dataframe and smart_datalake (#814) * refactor: extract import from file method * refactor: extract df head methods * refactor: move connector config in the relative connector file * refactor: csv and pandas files are now treated as a connector * chore: remove verbose getters and setters * refactor: remove load and save feature * refactor: create dataframe proxy * chore: simplify agent * chore: simplify datalake * refactor: simplify smart datalake * refactor: centralize context in lakes * refactor: move lake callbacks to dedicate class * fix: load connector before generating cache hex * fix: only allow direct sql to SQLConnectors * fix: check sql connector was not working * fix(connector): update connector validation at the start * fix(direct_sql): fix some leftovers * fix: merged change revert built-in shadowing --------- Co-authored-by: ArslanSaleem <khan.arslan38@gmail.com> * refactor(query_tracker): clean code and create error handling pipeling (#875) * refactor(smart_datalake): clean chat method of smart datalake * refactor(smartlake_pipeline): minor cleanups and comments * refactor(query_tracker): refactor query tracker input and output * refactor(query_tracker): adding error pipeline * refactor(query_tracker): some rename and delete extras * refactor(query_tracker): remove comments * Merge Main Changes to v1.6 (#878) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * refactor: remove inheritance of pandas methods in the SmartDataframe * refactor: remove shortcuts * refactor: smart df cannot chat anymore * refactor: remove unused validate method from sdf * refactor: add name and description to connectors * refactor: remove custom prompts * refactor: remove synthetic pipelines * refactor: remove custom instructions * refactor: remove starcoder and falcon * refactor: move df head to connectors * refactor: remove sdf * refactor: remove leftovers logic units * refactor: rename SmartDataLake to AgentCore * refactor: rename DataLake pipeline to Chat * refactor: remove agent core, moving the logic to agent * refactor: refactor the prompt templates using Jinja2 * feat(Agent): train agent docs or question/answers (#895) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained data from vector db in prompt (#896) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained vector in prompt * Merge v1.6 into to v2.0 (#900) * refactor(Prompt): adding more context for dataframe and multiple types of serialization (#880) * refactor(prompt): update dataframe serialization in prompt * tests(prompt): fix and adding new tests * fix(prompt): adding type to dataframe serialize function * refactor(prompt): add field descriptions in yml prompt * fix(prompt): direct_sql still using old dataframe table * refactor(direct_sql): add instruction and note for using relevant table only * refactor(query_tracker): clean output of query tracker format (#888) * feat(GoogleBigQuery): adding google big query connector (#886) * feat(VectorStore): adding chromadb vector store for RAG * test(agent_train): adding more test cases and error handling * refact(agent_train): add logging to chroma db * feat(RAG): use trained vector in prompt * Merge v1.6 to v2.0 * feat: execute_sql_query_usage creating error prompt if execute_sql_que… (#898) * feat/execute_sql_query_usage creating error prompt if execute_sql_query is not used when direct_sql is set to true * fix/comment added before raising exception --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-Air.digi.box> * fix(prompt_path): path issue if pandasai used outside of pandas env (#909) * feat(agent): adding optional pipeline call (#916) s * feat(system prompt): use system in llm prompts (#925) * fix(code_manager): minor fixes in code manager * feat(system_prompt): adding system prompts to be added in llm call * fix(code_manager): minor fixes in code manager (#923) Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * feat/update method in vector db added * feat/get by id method added * feat(multiturn-conv): update prompts and use api's for multiturn (#928) * fix(code_manager): minor fixes in code manager * feat(system_prompt): adding system prompts to be added in llm call * feat(multi-turn-conv): adding support for multi turn conversation * feat(multi-turn): add missing files * feat(BambooVectorStore): adding bamboo vector to store and retrieve t… (#935) * feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud * rename test class name * feat(BambooLLM): add bamboo llm wrapper (#940) * feat(BambooVectorStore): adding bamboo vector to store and retrieve training docs on cloud * rename test class name * feat(bamboo_llm): adding bamboo llm interface * fix: clean up few commented and leftover changes * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * Merge to release 2.0 (#945) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default * fix(skills): add skills to query tracker and by default rag to return 1 message (#947) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * fix: function call check and query tracker tracking * fixes/in release2.0 (#951) * fix(output_type): handle errors for wrong output type (#866) * fix(output_type): handle errors for output type * fix: leftovers * fix: test case to mock format-response * fix: upgrade duckdb * Release v1.5.15 * fix(sql): use only added tables of connector (#869) * fix(sql): use only added tables of connector * leftover file * chore: rephrase the error message Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * fix(sql): fix test cases and improve output error message --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> * feat/integration_testing test cases created (#873) * feat/integration_testing test cases created based Loan Payments data * feat/integration_testing four more datasets added * fix/moved csv datasets to integration folder * fix/changed pytest command to run only in tests folder * fix/changed pytest command to run only in tests folder --------- Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned (#876) * fix: rephrase query (#872) * Fixed Agent rephrase_query Error * Fixed Agent rephrase_query Error * add encoding --------- Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> * Release v1.5.16 * fix(code manager): parsing of called functions (#883) * feat(helpers): add gpt-3.5-turbo-1106 fine-tuned * fix(code manager): parsing of called functions * fmt * fix: open charts return on format plot (#881) Co-authored-by: Long Le <longlh@tech.est-rouge.com> * feat(project): add Makefile, re-lint project, restructure tests (#884) * feat(project): add Makefile, re-lint project, restructure tests * unused imports * Release v1.5.17 * docs:pdate examples.md (#887) Minor fix of exmaples.md * refactor: TypeVar for IResponseParser (#889) (#890) * refactor: TypeVar for IResponseParser (#889) * (refactor): introduce TypeVar for IResponseParser implementation in output_logic_unit.py * (fix): add missing call of super().__init__() in ProcessOutput class * refactor: TypeVar for IResponseParser (#889) * (style): linter fail at output_logic_unit.py * [fix] logging chart saving only if code contains chart (#897) Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> * fix(airtable): use personal access token instead of api key Api key has been deprecated: https://airtable.com/developers/web/api/authentication * feat: add df summarization shortcut (#901) * fix: badge for "Open in Colab" (#903) * feat: add support Google Gemini API in LLMs (#902) * Updating shortcuts to include df summarization * Updating support for google gemini models * Make google-generativeai package optional * fix: upgrade google-ai --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * Release v1.5.18 * docs: update Google Colab Badge (#914) The existing badge's signature was somehow seems to be expired so just add Google Colab's officially provided svg badge. * docs: Rectify code examples by adding missing statements (#915) Anyone who is quite new to python won't be able to simplify code errors when directly copied code demo from official website. Updated code example is taken from the root README.md and tested. * feat: add support for modin (#907) * feat: add support for modin * fix(ci): dev deps * update docs * add some tests * upate contributing guidelines * fix helpers * fix docs example * update pandasai/smart_dataframe/__init__.py * Release v1.5.19 * feat: update OpenAI pricing * chore: add Flask openai example (#941) * 'Refactored by Sourcery' * chore: add Flask html example * chore: add Flask openai example * sourcery refactor integration tests * fix: Flask package install set to optional --------- Co-authored-by: Sourcery AI <> * chore: restore smart dataframe and smartdatalake functionalities * fix ruff formatting * fix: yahoo connector * fix: file import sorting * fix: import sorting * fix: module import * ignore integration_tests * fix: ruff * ruff fix * remove integration folder * fix: ci workflow * fix: modin * fix: ruff imports * fix(plot): always pass one lib for plotting in updated prompt * fix: query tracker track code execution * fix: add skills in query tracker and rag to return one sample by default * fix: function call check and query tracker tracking --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * update comparison operator (#953) * docs: improve readme and license * lint: fix lint in examples * docs: add deploy methods in the documentation * refactor: rename to ChromaDB * feat: make BambooVector the default vectorstore * lint: fix lint in examples * docs: add docs for training, agent description * docs: add video for training LLM --------- Co-authored-by: ArslanSaleem <khan.arslan38@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-Air.digi.box> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> * feat: fix poetry.lock * fix: update domain name (#970) * docs: improve docs about training * fix(agent): langchain LLM instantiation (#977) * fix(agent): langchain LLM instantiation * replace object with mock * feat: add support for Gemini API * Release v2.0.2 * fix(llm): Google Gemini signature and memory usage (#980) * Release v2.0.3 * Release v2.0.3 * build: fix issue * build: fix ci for windows (#1005) * fix: add number result to memory as string (#997) Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * fix: remove logger refs from SmartDataframe (#985) * Remove logger from smart_dataframe constructor * Remove logger from SmartDatalake args definition --------- Co-authored-by: Gabriele Venturi <lele.venturi@gmail.com> * chore(code_manager): filter code for redeclaration of pd.DataFrame from head (#1003) * feat(CockroachDBConnector): add support for cockroachdb * fix: cockroach db connector * fix: import polars (#1009) * Update polars dependency Move polars dependency into init to make it optional * fix: polars import * fix: fix linter --------- Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> * Release v2.0.4 * Release v2.0.5 --------- Co-authored-by: ArslanSaleem <khan.arslan38@gmail.com> Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com> Co-authored-by: milind-sinaptik <149694044+milind-sinaptik@users.noreply.github.com> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-MacBook-Air.local> Co-authored-by: Massimiliano Pronesti <massimiliano.pronesti@gmail.com> Co-authored-by: Pranab1011 <47911727+Pranab1011@users.noreply.github.com> Co-authored-by: Pranab Pathak <pranabpathak@Pranabs-MacBook-Air.local> Co-authored-by: Milind Lalwani <milindlalwani@Milinds-Air.digi.box> Co-authored-by: Lh Long <lhlong09t4@gmail.com> Co-authored-by: Long Le <longlh@tech.est-rouge.com> Co-authored-by: PVA <37487002+PavelAgurov@users.noreply.github.com> Co-authored-by: Ihor <31508183+nautics889@users.noreply.github.com> Co-authored-by: Lorenzo Battistela <70359945+Lorenzobattistela@users.noreply.github.com> Co-authored-by: Lorenzobattistela <lorenzobattistela@gmail.com> Co-authored-by: Sparsh Jain <31439850+dudesparsh@users.noreply.github.com> Co-authored-by: Devashish Datt Mamgain <devashish@kommunicate.io> Co-authored-by: Hemant Sachdeva <hemant.evolver@gmail.com> Co-authored-by: aloha-fim <15258433+aloha-fim@users.noreply.github.com> Co-authored-by: Cheng Wai <17866260+chengwaikoo@users.noreply.github.com>

fix(code_manager): minor fixes in code manager

76897ef

ArslanSaleem requested a review from gventuri February 3, 2024 21:45

sourcery-ai bot reviewed Feb 3, 2024

View reviewed changes

Merge branch 'release/v2.0' into fix/code_manager

d993185

gventuri merged commit c65e1d7 into release/v2.0 Feb 5, 2024
2 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

fix(code_manager): minor fixes in code manager #923

fix(code_manager): minor fixes in code manager #923

ArslanSaleem commented Feb 3, 2024

coderabbitai bot commented Feb 3, 2024

Auto Review Skipped

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configration File (`.coderabbit.yaml`)

CodeRabbit Discord Community

sourcery-ai bot left a comment

sourcery-ai bot Feb 3, 2024

sourcery-ai bot Feb 3, 2024

sourcery-ai bot Feb 3, 2024

sourcery-ai bot Feb 3, 2024

codecov-commenter commented Feb 3, 2024

fix(code_manager): minor fixes in code manager #923

fix(code_manager): minor fixes in code manager #923

Conversation

ArslanSaleem commented Feb 3, 2024

coderabbitai bot commented Feb 3, 2024

Auto Review Skipped

Chat

CodeRabbit Commands (invoked as PR comments)

CodeRabbit Configration File (.coderabbit.yaml)

CodeRabbit Discord Community

sourcery-ai bot left a comment

Choose a reason for hiding this comment

sourcery-ai bot Feb 3, 2024

Choose a reason for hiding this comment

sourcery-ai bot Feb 3, 2024

Choose a reason for hiding this comment

sourcery-ai bot Feb 3, 2024

Choose a reason for hiding this comment

sourcery-ai bot Feb 3, 2024

Choose a reason for hiding this comment

codecov-commenter commented Feb 3, 2024

Codecov Report

CodeRabbit Configration File (`.coderabbit.yaml`)