Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Spark NLP 5.5.2 Release Candidate #14473

Merged
merged 13 commits into from
Dec 18, 2024
Merged

Spark NLP 5.5.2 Release Candidate #14473

merged 13 commits into from
Dec 18, 2024

Conversation

maziyarpanahi
Copy link
Member

@maziyarpanahi maziyarpanahi commented Dec 9, 2024 •
edited
Loading

ahmedlone127 and others added 12 commits December 9, 2024 15:22
@ahmedlone127
adding openvino support to all ClassificationForXXX annotators (#14408)
4b2aa30 
* adding DebertaForXXX support

* Uploading the remaining files

* Delete examples/python/transformers/openvino/HuggingFace_OpenVINO_in_Spark_NLP_CamemBERT.ipynbshield

* Delete examples/python/transformers/openvino/HuggingFace_OpenVINO_in_Spark_NLP_XlmRoBertaForTokenClassification.ipynbshield

* Delete examples/python/transformers/openvino/HuggingFace_OpenVINO_in_Spark_NLP_XlmRoBertaForZeroShotClassification.ipynbshield

* adding openvino Suppor tto multiple Annotators

* Update Bart.scala
@danilojsl
[SPARKNLP-1068] Introducing BLIPForQuestionAnswering transformer (#14422
6d3b273 
)

* [SPARKNLP-1068] Introducing BLIPForQuestionAnswering transformer

* [SPARKNLP-1068] Adding BLIPForQuestionAnswering import notebook example

* [SPARKNLP-1068] Fix fullAnnotateImage validation

* [SPARKNLP-1068] Solves BLIPForQuestionAnsweringTest issue

* [SPARKNLP-1068] Updates default BLIPForQuestionAnswering model name

* [SPARKNLP-1068] [skip test] Adding documentation to BLIPForQuestionAnswering
@DevinTDHa @maziyarpanahi
[SPARKNLP-1091] AutoGGUFModel embeddings support (#14433)
978f55b 
* Split HasLlamaCppProperties to HasLlamaCppModelProperties and HasLlamaCppInferenceProperties

* Refactor automatic gpu support

* [SPARKNLP-1091] AutoGGUFEmbeddings scala side

- also adds embedding support for AutoGGUFModel, as it already has the parameter

* [SPARKNLP-1091] AutoGGUFEmbeddings python side

* [SPARKNLP-1091] Update Documentation

* [SPARKNLP-1091] Update AutoGGUFEmbeddingsTests

* [SPARKNLP-1091] AutoGGUFEmbeddings python side

- Also adds example notebook

* [SPARKNLP-1080] AutoGGUFEmbeddings change default pretrained model

* [SPARKNLP-1091] AutoGGUFEmbeddings Set Defaults

---------

Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
@maziyarpanahi
Apache Spark vulnerable Fix (#14441)
38dfa46 
This is not really a vulnerability fix since the dep is in the docs and is not used. But for the sake of removing the security alert.
@DevinTDHa
[SPARKNLP-1095] Add installation instructions for ONNX GPU on Databri…
dfae801 
…cks (#14451)
@danilojsl
[SPARKNLP-1093] Adding support to read Email files (#14455)
1429482 
* [SPARKNLP-1089] Adding support to read HTML files

* [SPARKNLP-1089] Adding documentation and support for set of URLs in python

* [SPARKNLP-1089] Adding input validation in python

* [SPARKNLP-1093] Adding support to read email files

* [SPARKNLP-1093] Adding reading email notebook example
@svlandeg
Small typos (#14459)
3302205
@mehmetbutgul
Addition chunk metadata to ChunkEmbeddings output (#14462)
aefe88f 
* create AnnotationUtils helper class for testing

* create AnnotationUtils helper class for testing
@danilojsl
[SPARKNLP-1096] Adding support to Microsoft Fabric for WordEmbeddings…
3596ded 
… storage index (#14467)
@ahmedlone127 @maziyarpanahi
Default name updates (#14469)
59f91bc 
* Default name updates

* name param should be str

* adding CPMTransformer to ResourceDwonloader

* Update ResourceDownloader.scala

---------

Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
@maziyarpanahi
Merge branch 'master' into release/552-release-candidate
48c61bb
@danilojsl
SPARKNLP-1094 Adding Support to Read Word Files (#14476)
acc9369 
* [SPARKNLP-1094] Adding support to read Word files

* [SPARKNLP-1094] Adding test doc examples

* [SPARKNLP-1094] Adding notebook example for Word files

* [SPARKNLP-1094] Adding latest jakarta mail dependencies

* [SPARKNLP-1094] Updating notebooks documentation

* [SPARKNLP-1094] Updating Databricks documentation
@maziyarpanahi maziyarpanahi merged commit 2221e60 into master Dec 18, 2024
8 of 9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@danilojsl danilojsl danilojsl approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@maziyarpanahi @danilojsl @ahmedlone127 @DevinTDHa @svlandeg @mehmetbutgul