Multimodal fix - multiple changes to chat agent module to support multimodal I/O #60
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Dependency Review✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.OpenSSF Scorecard
Scanned Manifest Files |
pranav-kural
added a commit
that referenced
this pull request
Aug 1, 2024
* updated cache store to support multimodal inputs #43 * updates to cache store for multimodality #43 * updated define chat endpoint logic to support multimodal input output and verbose mode * fixed endpoint output schema to support verbose response * updated tests to support multimodal input output (tests only use text I/O for now) #43 * formatting change * added changes to setup `alpha` branch for alpha release * Added Changes to prompts, chat agent, endpoints to support Multimodal I/O (#57) * added DALL-E 3 to supported models * Updated prompts with partials and custom output schema #43 * updated prompts for multimodality #43 * Updated chat agent class for multimodal I/O #43 * Updated defineChatEndpoint to support multimodal I/O #43 * bumped NPM package for alpha release * Fixed issues with basic system prompt + added default system prompts #43 (#59) * Multimodal fix - multiple changes to chat agent module to support multimodal I/O (#60) * Fixed issues with basic system prompt + added default system prompts #43 * multiple changes to chat agent module to support multimodal I/O * bumped package version for alpha release * Models patch - fixes for multimodal support + implementation of `configureAndRunServer` method #43 #54 (#63) * fix for LLM model configurations type inference (Gemini, OpenAI, DALL-E) #43 * Bumped pre-release package version + removed dependency on genkit-langchain and genkit-chromadb * added the `configureAndRunServer` method #54 + moved exports for server and genkit to root level * Final merge for v2 pre-release branch (#71) * removed dependency on @genkit-ai/firebase and @genkit-ai/firebase #67 * Refactored codebase to implement type-only imports and export #68 * Implemented logic to reset cache record on expiry #69 + fixed #66 * updated implementation of method for cache store #69 * re-factored and re-organized code to export `defineChatEndpoint` from root #70 * updated `langchain` to v0.2.12 + added badges to README #66 * Bumped pre-release version - final for v2 * Remove alpha NPM package workflow + changed package version to 2.0.0 * fixed workflows for pre-deploy build + code scanning
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
multiple changes to chat agent module to support multimodal I/O