Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/add conversation logger merged #1385

Merged
merged 74 commits into from
Oct 13, 2024

Conversation

emrgnt-cmplxty
Copy link
Contributor

@emrgnt-cmplxty emrgnt-cmplxty commented Oct 11, 2024

Important

This PR adds a conversation logging feature with history and branching support, updates API endpoints, models, and tests to manage conversations effectively.

  • Behavior:
    • Adds conversation logging feature with support for conversation history and branching in core/base/logging/run_logger.py.
    • Introduces new API endpoint /v2/conversations/{conversation_id} in management_router.py to retrieve conversation history.
    • Updates agent_app in retrieval_router.py to handle conversation IDs and branching.
  • Models:
    • Adds WrappedConversationResponse in management/responses.py for conversation data.
    • Updates RAGAgentResponse in retrieval/responses.py to include conversation_id.
  • Tests:
    • Adds tests for conversation logging in test_chat_logging_provider.py.
    • Adds integration test test_conversation_history_sdk in runner_sdk.py.
  • Misc:
    • Removes score_completion functionality from management_router.py and related files.
    • Updates Message class in llm.py to support new conversation features.

This description was created by Ellipsis for 81eef69. It will automatically update as commits are pushed.

shreyaspimpalgaonkar and others added 30 commits October 8, 2024 09:31
* cli tests

* add sdk tests

* typo fix

* change workflow ordering

* add collection integration tests (#1352)

* bump pkg

* remove workflows

* fix sdk test port

* fix delete collection return check

* Fix document info serialization (#1353)

* Update integration-test-workflow-debian.yml

* pre-commit

* slightly modify

* up

* up

* smaller file

* up

* typo, change order

* up

* up

* change order

---------

Co-authored-by: emrgnt-cmplxty <68796651+emrgnt-cmplxty@users.noreply.github.com>
Co-authored-by: emrgnt-cmplxty <owen@algofi.org>
Co-authored-by: Nolan Tremelling <34580718+NolanTrem@users.noreply.github.com>
* add documentation

* up

* Update js/sdk/src/models.tsx

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>

* pre-commit

---------

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
* cleanups

* add back overzealous edits

* extend workflows

* fix full setup

* simplify cli

* add ymls

* rename to light

* try again

* start light

* add cli tests

* fix

* fix

* testing..

* trying complete matrix testflow

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* up

* up

* up

* All actions

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* try offic pgvec formula

* sudo make

* sudo make

* push and pray

* push and pray

* add new actions

* add new actions

* docker push & pray

* inspect manifests during launch

* inspect manifests during launch

* inspect manifests during launch

* inspect manifests during launch

* setup docker

* setup docker

* fix default

* fix default
* cleanups

* add back overzealous edits

* extend workflows

* fix full setup

* simplify cli

* add ymls

* rename to light

* try again

* start light

* add cli tests

* fix

* fix

* testing..

* trying complete matrix testflow

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* cleanup matrix logic

* up

* up

* up

* All actions

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* rename to runner

* try offic pgvec formula

* sudo make

* sudo make

* push and pray

* push and pray

* add new actions

* add new actions

* docker push & pray

* inspect manifests during launch

* inspect manifests during launch

* inspect manifests during launch

* inspect manifests during launch

* setup docker

* setup docker

* fix default

* fix default

* make changes
emrgnt-cmplxty and others added 14 commits October 10, 2024 21:22
* up

* up

* modify assertion

* up

* up

* increase entity limit

* changing aristotle back to v2

* pre-commit

* typos

* add test_ingest_sample_file_2_sdk
* add docs and refine code

* add python SDK documentation

* up
Copy link

vercel bot commented Oct 11, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
yc_demo ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 13, 2024 5:06pm
yc-demo ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 13, 2024 5:06pm
1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
recommendation_platform ⬜️ Ignored (Inspect) Oct 13, 2024 5:06pm

@emrgnt-cmplxty emrgnt-cmplxty marked this pull request as ready for review October 13, 2024 17:24
@emrgnt-cmplxty emrgnt-cmplxty merged commit 975a405 into main Oct 13, 2024
13 of 46 checks passed
Copy link
Contributor

@ellipsis-dev ellipsis-dev bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Looks good to me! Reviewed everything up to 81eef69 in 1 minute and 21 seconds

More details
  • Looked at 2662 lines of code in 41 files
  • Skipped 0 files when reviewing.
  • Skipped posting 5 drafted comments based on config settings.
1. py/core/agent/base.py:54
  • Draft comment:
    The arun method has a TODO comment indicating it should return a list of messages. Ensure this is implemented as intended.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    The arun method in py/core/agent/base.py has a TODO comment indicating that it should return a list of messages. This is a clear indication that the current implementation might not be complete or correct as per the intended design.
2. py/core/base/logging/run_logger.py:132
  • Draft comment:
    The edit_message method creates a new branch and message. Ensure this doesn't lead to unnecessary data duplication.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    The edit_message method in py/core/base/logging/run_logger.py creates a new branch and a new message when editing. This might lead to unnecessary data duplication if not handled properly. Consider optimizing this process.
3. py/core/base/logging/run_logger.py:303
  • Draft comment:
    The get_conversation method returns an empty list if no branches are found. Consider raising an exception or returning a more informative response.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    The get_conversation method in py/core/base/logging/run_logger.py returns an empty list if no branches are found. This might not be the best way to handle this case, as it could lead to confusion. Consider raising an exception or returning a more informative response.
4. py/core/main/api/retrieval_router.py:216
  • Draft comment:
    The agent_app function has both message and messages parameters, with messages marked as deprecated. Consider removing the deprecated parameter to avoid confusion.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    In py/core/main/api/retrieval_router.py, the agent_app function has both message and messages parameters, with messages marked as deprecated. This could lead to confusion. Consider removing the deprecated parameter.
5. py/core/main/services/retrieval_service.py:370
  • Draft comment:
    Remove or replace the print statement with proper logging.
  • Reason this comment was not posted:
    Confidence changes required: 50%
    In py/core/main/services/retrieval_service.py, the agent method has a print statement for debugging purposes. This should be removed or replaced with proper logging before merging.

Workflow ID: wflow_pqTDm2WhIpjlSpEK


You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

@emrgnt-cmplxty emrgnt-cmplxty deleted the feature/add-conversation-logger-merged branch October 25, 2024 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants