Release/430 release candidate #13346
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Member
maziyarpanahi
commented
Jan 14, 2023
•
- SPARKNLP-695 Refactor ml package #13287
- SPARKNLP-666 use spark 3.3.1 as base #13288
- SPARKNLP-607: Implement HubertForCTC #13303
- SPARKNLP-606: Add SwinForImageClassification Annotator #13331
- Relocating public examples back to the main repository #13292
- Sparknlp 718 Zero Shot NER model annotator #13352
- Improvment for Issue Templates #13354
- [skip ci] SPARKNLP-725: Add PyDoc documentation for ResourceDownloader #13369
- SPARKNLP-712: Update example links #13419
- Remove Debug Print in LP #13420
- SPARKNLP-728 Avoid Copying Existing Models on S3/GCP #13423
- Fix calculating delimiter id in CamemBERT
- SPARKNLP-474 Introducing CamemBERT for Question Answering annotator #13289
- Documentation for 430 release candidate #13421
- SPARKNLP-734 Enable params argument in spark_nlp.start() #13441
- Sparknlp 736 Implement Date2Chunk annotator #13447
- SPARKNLP-733: Fix loadSavedModel for private buckets #13432
- SPARKNLP-712: Update links to example notebooks #13459
- Doc id conll reader #13410
- SPARKNLP-737: ZeroShotNer Notebook #13474
- Sparknlp 740 rename refactor m 1 to silicon #13476
- delimiter id is actually correct and doesn't need any offset
- annotator and ResourceDownloader
- anything that can be used by other DL engines - there are some features that are exclusively designed by using TensorFlow so they can stay in tensorflow package
- sometimes the import optimization doesn't follow scalafmt rules
…notator' into SPARKNLP-695-refactor-ml-module
- actually sentencepiece does use TensorFlow to load the SP model so it must stay in tensorflow package - io is also mostly used in loading TensorFlow models
- Spark 3.3.1 is now a default package for our APIs - GCP storage is updated to 2.16.0 from 2.15.0
- It needs to asset with `"The deserializer is not supported: need a(n) \"ARRAY\" field but got \"STRING\"."`
Removed the duplicated definition of method `setWeightedDistPath` from `ContextSpellCheckerApproach`.
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
* SPARKNLP-728 Verifies if model already exist in S3 before unzipping when cache_pretrained is defined as S3 bucket * SPARKNLP-728 Verifies if model already exist in GCP before unzipping when cache_pretrained is defined as GCP bucket
* [skip ci] SPARKNLP-709: Add Documentation - SwinForImageClassification, HubertForCTC - Added additional example for ViTForImageClassification * Fix some PyDocs and add ignore pattern to sphinx * Resolved some warnings for Sphinx * Improve WordSegmenter Docs * Resolve sphinx Warnings * Remove typo * SPARKNLP-709: Add documentation for ZeroShotNer
* SPARKNLP-734 Enable params argument in spark_nlp.start() * SPARKNLP-734 Revert cache_folder, log_folder and cluster_tmp_dir for backward compatibility
* Implement DateMatcher annotator * Add Date2Chunk annotator and unit test to Python - Move Token2Chunk to the base module - Add Date2Chunk to the Python APIs - Add Date2Chunk unit tests
* SPARKNLP-733: Fix loadSavedModel for private buckets - also resolves warnings * SPARKNLP-733: Check region for S3 loadSavedModel
* [skip ci] SPARK-NLP-721: New example notebooks * SPARK-NLP-721: Changed Notebook Links
* Doc Id column implementation * Including tests * Access tuple and not cleared variable for the doc and the sentence
* Update code style [skip test] * Refactor m1 to silicon - README/doc - dependencies (spark-nlp-silicon) - func (apple_silicon=True/true)
- no matter what, Intellij cannot ignore formatting *.ipynb notebooks! Exclude formatter even ignore file types are no help
- the www.johnsnowlabs.com/slack-redirect DNS redirect is forcing people to have @johnsnowlabs.com email in order to register - using the raw invitation URL fixes this issue
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.