release/550-release-candidate #14389
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
maziyarpanahi
commented
Sep 1, 2024
•
- SparkNLP 997 Introducing QWEN2Transformer #14188
- SparkNLP 1004 - Introducing MiniCPM #14205
- SparkNLP 1018 - Introducing NLLB #14209
- SparkNLP 1005 implement nomic embeddings #14217
- implementing SnowFlake #14353
- Introducing CamemBertForZeroShotClassification annotator #14354
- Implementing Mxbai Embeddings #14355
- Introducing onnx support to vision annotators #14356
- Introducing onnx and OpenVino support to Missing Annotators #14359
- [SPARKNLP-855] Introducing AlbertForZeroShotClassification #14361
- SparkNLP introducing Phi-3 #14373
- OpenVINO install instructions #14382
- SPARKNLP 1034 implement starcoder2 for causal lm #14358
- 550 rc export notebooks #14393
- [SPARKNLP-1027] llama.cpp integration #14364
* QwenTransformer scala api and tests * QwenTransformer python api and tests * QwenTransformer python api and tests * Added Openvino support
* MiniCPM Scala api and tests * added cpm python api and tests * changed to slow test type * Added Openvino support * Added Openvino support --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* added NLLB scala api * added NLLB python api * Added Openvino support * Added Openvino python support --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* added Nomic Scala api and tests * added Nomic python api and tests * Added Openvino support * Added Openvino support for python API --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* implementing SnowFlake * typo fix --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* Intoruding Onnx support to ConvNext,Swin and VIt * adding upload notebook for ConvNext * fixing colab link * adding support to VisionEncoderDecoder * Fixed ONNX input and outputs * adding Writing Support for Vison Encoder Decoder * adding example VisonEcnoderDecoder notebook * Update VisionEncoderDecoder.scala --------- Co-authored-by: Prabod Rathnayaka <prabod@rathnayaka.me>
* adding onnx API * Adding example notebook * Introducing ONNX support to DistilBertForZeroShotClassification * adding DistilBertForZeroShotClaissifcation onnx notebook * adding onnx support to RobertaForZeroShotClassificaiton * adding onnx support to XlmRobertaForZeroShotClassification * Create HuggingFace_ONNX_in_Spark_NLP_XlmRoBertaForZeroShotClassification.ipynb * adding ONNX support to BartTransformer * Create HuggingFace_ONNX_in_Spark_NLP_Bart.ipynb * adding onnx support to GPT2 * Refactoring GPT2 code * adding gpt 2 notebook * adding onnx support to Wav2Vec2 * adding onnx support to hubert * adding ONNX support to BartForZeroShotClassificaiton * adding ONNX support to DebertaForZeroShotClassificaiton * adding openVino support to Whisper * Create HuggingFace_OpenVINO_in_Spark_NLP_Whisper.ipynb * adding OpenVino Support to AlbertForXXX * changing unit tests back to origanl model paths * adding BartForZeroShotClassiifcation * adding openvino suppor tto BertForXXX classificaition
* [SPARKNLP-855] Introducing AlbertForZeroShotClassification * [SPARKNLP-855] Adding notebook examples for AlbertZeroShotClassification --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* Added Phi3 with openvino and onnx support * removed changes to phi2 and changed fasttest to slowtest --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* Added starcoder scala API * Added python api
* LLAMA3 Scala API * LLAMA3 Python API * LLAMA3 Notebook * LLAMA3 doc update
* MiniCPM and Qwen notebooks * NLLB Notebook * NLLB, Phi3 and Nomic export Notebooks
* [SPARKNLP-1027] Initial Tests passing * [SPARKNLP-1027] Implement Parameters Add metadata to AutoGGUFModel * [SPARKNLP-1027] Add metadata to AutoGGUFModel * [SPARKNLP-1027] Scala Side * [SPARKNLP-1027] Initial Python Tests running and parameters fixed * [SPARKNLP-1027] AutoGGUFModel can auto-detect GPU * [SPARKNLP-1027] Complete Documentation * [SPARKNLP-1027] Add missing parameters * [SPARKNLP-1027] Add Support for StructFeature setters on python side * [SPARKNLP-1027] Add llama.cpp dependencies * [SPARKNLP-1027] getMetadata for Python side * Bump jsl-llamacpp to 0.1.0-rc3 * [SPARKNLP-1027] Exception Handling and Finalize tests * [SPARKNLP-1027] Update jsl-llamacpp version * [SPARKNLP-1027] Update Documentation * [SPARKNLP-1027] Remove old Parameters --------- Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
…hnSnowLabs/spark-nlp into release/550-release-candidate
danilojsl
approved these changes
Sep 7, 2024
* adding OpenVino support to CamembertForXXX * adding openvino support to CamembertForXXX * Update CamemBertClassification.scala * fixed syntax * Update CamemBertForZeroShotClassification.scala
|
Hi @maziyarpanahi I had to change the default pretrained model for the AutoGGUF model, due to some compatibility issue with the updated llamacpp version. The PR is here: #14411 Just a couple of small string changes. If it looks good to you it can be merged! |
* [SPARKNLP-1027] Change Default AutoGGUF pretrained model * [SPARKNLP-1027] Change default model in example * [SPARKNLP-1027] Fix issue with pretrained model
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.